Comment Re:Story checks out. (Score 1) 93
>The statistical methods used medical studies are relatively much simpler than in say, engineering. That's not where gotchas are. So we need robust studies, a convergence of evidence, and meta-analyses from competent centers.
I don't follow (that last line). Engineering, at least in my area uses fairly simple models because we can get lots of data and we can control confounders because silicon doesn't care the same way that human subjects do. E.G. for PUF reliability you can measure the distribution of pairwise hamming distance across thousands of chips. This is more conservative than golden value hamming distance, but you compensate for the drop in sensitivity by getting more data.
The need for meta analyses in medicine comes about because of the large amount of underpowered studies in medicine and nutrition. The use of statistics in the source studies is often, well creative. The metas read like the statistical clean up crew. It feels like larger studies (costing more, I know) would lead to simpler statistics - but that's a guess.
Definitely I've come to 'trust' some researchers to do the research in a way that you know the claims match the data, because they've been consistent in doing that. Many others I just ignore for the opposite reason. Medicine has had its research problems, but nutrition research is where the real shit show has been going on for decades.