I like what Epicurus did, at least when he was talking about the weather in the letter to Pythocles.
Instead of giving one explanation of lightning, he gives multiple contradictory explanations. The point is they all fit the observations and are at least as plausible as “Zeus did it”.
This feels right from a Bayesian perpsective, where uncertainty about a prediction about a future event F can come from averaging P(F|H) over all the hypotheses H compatible with past evidence E. (More properly P(F|H&E); it becomes P(F|H) when the hypotheses have no free parameters learned from the data.)
I guess I want people to do more storytelling, not less; I want them to realize how cheap these plausible-sounding stories really are.
And, of course, when certainty is appropriate, I want them to notice that their plausible-sounding alternatives actually do not fit the available evidence, or don’t predict it with the same strength. Epicurus failed at this, unfortunately, because he was dismissive of astronomy. So he said maybe the moon reflects sunlight and maybe it has its own light, when astronomers had already noticed that as the moon goes through its phases, the illuminated part matches the location of the sun.
This is a tangent, but regarding the meta-analysis you linked saying that open-label placebos still work, what do you think of the interpretation (which I favor) that they don’t work but the patients think they do? I think this is supported by the comparison of self-reported vs objective outcomes in the study.