I think this is a key point—given a list of choices, people compare each one to the original statement and say “how well does this fit?” I certainly started that way before an instinct about multiple conditions kicked in. Given that, its not that people are incorrectly finding the chance that A-F are true given the description, but that they are correctly finding the chance that the description is true, given one of A-F.
I think the other circumstances might display tweaked version of the same forces, also. For example, answering the suspension of relations question not as P(X^Y) vs P(Y), but perceiving it as P(Y), given X.
I understand the point you’re raising, because it caught me for a while, but I think I also see the remaining downfall of science. Its not that science leads you to the wrong thing, but that it cannot lead you to the right one. You never know if your experiments actually brought you to the right conclusion—it is entirely possible to be utterly wrong, and complete scientific, for generations and centuries.
Not only this, but you can be obviously wrong. We look at people trusting in spontaneous generation, or a spirit theory of disease, and mock them—rightfully. They took “reasonable” explanations of ideas, tested them as best they could, and ended up with unreasonable confidence in utterly illogical ideas. Science has no step in which you say “and is this idea logically reasonable”, and that step is unattainable even if you add it. Science offers two things—gradual improvement, and safety from being wrong with certainty. The first is a weak reward—there is no schedule to science, and by practicing it there’s a reasonable chance that you’ll go your entire life with major problems with your worldview. The second is hollow—you are defended from taking a wrong idea and saying “this is true” only inasmuch as science deprives you of any certainty. You are offered a qualifier to say, not a change in your ideas.