This is true, and a good warning. There's a whole industry of stuff like AlphaBrain out there that's dubiously effective, understudied, under-tested for purity, and generally scary. But I also think there's an awful lot of literature about most single-substance nootropics. It's the complex stacks that are totally unstudied.
Creatine, for instance, has been studied for mental effects a bunch of times - the answers all seem to line up on "can definitely help some people, but probably insignificant to most". Other substances shake out similarly - the data on bacopa is inconclusive, but the studies are numerous enough to suggest that the inconclusiveness is about a very weak or situational effect, not a lack of literature.
The vegetarian point does touch on my larger concern, though: people talk like studies finding weak 'average effects' mean the drug is universally effective, but low-powered. That's possible, but it seems more likely that there are lots of drugs which are situationally powerful (e.g. based on diet or genetics) and hardly any that are good for everyone. Creatine is obvious, and I kind of suspect cholinergics and bacopa for this also. Gwern is really good about acknowledging that his studies (of n=1) aren't being designed to apply to anyone else, but most people don't offer that caveat.
Comments
This is true, and a good warning. There's a whole industry of stuff like AlphaBrain out there that's dubiously effective, understudied, under-tested for purity, and generally scary. But I also think there's an awful lot of literature about most single-substance nootropics. It's the complex stacks that are totally unstudied.
Creatine, for instance, has been studied for mental effects a bunch of times - the answers all seem to line up on "can definitely help some people, but probably insignificant to most". Other substances shake out similarly - the data on bacopa is inconclusive, but the studies are numerous enough to suggest that the inconclusiveness is about a very weak or situational effect, not a lack of literature.
The vegetarian point does touch on my larger concern, though: people talk like studies finding weak 'average effects' mean the drug is universally effective, but low-powered. That's possible, but it seems more likely that there are lots of drugs which are situationally powerful (e.g. based on diet or genetics) and hardly any that are good for everyone. Creatine is obvious, and I kind of suspect cholinergics and bacopa for this also. Gwern is really good about acknowledging that his studies (of n=1) aren't being designed to apply to anyone else, but most people don't offer that caveat.