Now, one basic principle in all of science is GIGO: garbage in, garbage out. This principle is particularly important in statistical meta-analysis: because if you have a bunch of methodologically poor studies, each with small sample size, and then subject them to meta-analysis, what can happen is that the systematic biases in each study — if they mostly point in the same direction — can reach statistical significance when the studies are pooled. And this possibility is particularly relevant here, because meta-analyses of homeopathy invariably find an inverse correlation between the methodological quality of the study and the observed effectiveness of homeopathy: that is, the sloppiest studies find the strongest evidence in favor of homeopathy. When one restricts attention only to methodologically sound studies — those that include adequate randomization and double-blinding, predefined outcome measures, and clear accounting for drop-outs — the meta-analyses find no statistically significant effect (whether positive or negative) of homeopathy compared to placebo.
Alan Sokal, What Is Science
Robert Burton, from On Being Certain: Believing You’re Right Even When You’re Not reminding me of Epiphany Addictions