I think the article is about something different. Something like this:
You prefer policy X.
You read in a newspaper “We asked random people on the street, and 9 out of 10 supported policy X.”
You say: “Come on, the should finally give up, now that they see that pretty much everyone wants X.”
Scenario A:
You are told to suspend all your biases for a moment, and evaluate impartially whether “9 out of 10 random people on the street” really makes a strong argument in favor of the policy.
Your brains automatically generates a clever excuse: “Of course, wisdom of the crowds, Aumann’s agreement theorem, however you call it; if something makes sense so obviously that 9 out of 10 people notice it, we should take this very seriously!”
Scenario B:
You are told to imagine a parallel world, where the newspaper reported (let’s assume that truthfully) that when asking random people on the street, 9 out of 10 opposed policy X.
Your brain automatically generates a clever excuse: “But asking random people on the street is nonsense! If you want to evaluate an impact of a policy, you need to ask experts. Random people believe all kind of stupid things. Also, how large was the random sample? Was it representative for the whole country? Without these information, the article shouldn’t be taken seriously.”
Then you return to the real world, and notice that the same arguments apply in the opposite direction, too. Sure, your priors in favor of the policy X remain the same, but you no longer consider the articles in the newspaper a strong evidence in your favor.
I think the article is about something different. Something like this:
You prefer policy X.
You read in a newspaper “We asked random people on the street, and 9 out of 10 supported policy X.”
You say: “Come on, the should finally give up, now that they see that pretty much everyone wants X.”
Scenario A:
You are told to suspend all your biases for a moment, and evaluate impartially whether “9 out of 10 random people on the street” really makes a strong argument in favor of the policy.
Your brains automatically generates a clever excuse: “Of course, wisdom of the crowds, Aumann’s agreement theorem, however you call it; if something makes sense so obviously that 9 out of 10 people notice it, we should take this very seriously!”
Scenario B:
You are told to imagine a parallel world, where the newspaper reported (let’s assume that truthfully) that when asking random people on the street, 9 out of 10 opposed policy X.
Your brain automatically generates a clever excuse: “But asking random people on the street is nonsense! If you want to evaluate an impact of a policy, you need to ask experts. Random people believe all kind of stupid things. Also, how large was the random sample? Was it representative for the whole country? Without these information, the article shouldn’t be taken seriously.”
Then you return to the real world, and notice that the same arguments apply in the opposite direction, too. Sure, your priors in favor of the policy X remain the same, but you no longer consider the articles in the newspaper a strong evidence in your favor.