I think if anything in his review set off my instinct that I had to write “https://thezvi.wordpress.com/2017/11/27/you-have-the-right-to-think/″ (which is sitting at −1 here which I’m sad about, but it got great discussion on my blog itself, which I think combines to valuable feedback on many levels that I’m still processing, and I’m thankful for people’s candor).
The first part is an absurd Isolated Demand for Rigor, in violation of any reasonable rules of good writing and of common sense. Experts never seem to need to prove any of that stuff, but suddenly Eliezer’s book is supposed to stop to provide expert-approved outside-view proof for the idea that being better at thinking and avoiding mistakes might make one better at thinking and avoiding mistakes. Magnitude is a legitimate question, but come on. You’re not allowed to use evidence of your meta-rationality that isn’t approved by the licensing court, or something? And even if the eivdence is blatant and outside view-approved you need to present all of it yourself explicitly?
The second half then says something that keeps being claimed and simply isn’t true: That you have to be ‘more meta-rational’ or otherwise superior to others who have beliefs, in some way in order to have an opinion (to think) on something. Otherwise, your object-level evidence needs to be thrown out (in his comments he said multiple times no, don’t throw out your object-level evidence, that’s obviously wrong, but what else would it mean not to be able to judge?) This is insane. You don’t need that at all. You just need to be good enough that your observations and analysis aren’t zeroed out and fully priced in by the experts, which is a much lower bar. You could easily have different data, apply more compute, or do any number of other things, and even if you don’t your likelihood ratio isn’t going to be 1.
Robin Hanson: “You are never entitled to your own beliefs” i.e. there are rules of reasoning about evidence and is you state probabilities that are inconsistent with the evidence you’ve seen you’re lying.
Zvi: “You are entitled to your own beliefs” i.e. there are many many MANY social pressures pushing for you to cast aside the evidence you’ve noticed for dissenting ideas, in favour of socially modest beliefs. Resist these pressures, for they are taking away your very right to think! (#LetsAssumeRightsExist)
And thus, a community deep in the first phrase, reacted poorly to the second. I admit, until I read the comment section of your post, I had not been able to at all form the charitable and correct reading of your post.
If/when I point to empirical evidence that practising using bayes’ theorem does in fact help your meta-rationality, my model of Pat Modesto says “Oh, so you claim that you have ‘empirical’ evidence and this means you know ‘better’ than others. Many people thought they too had ‘special’ evidence that allowed them to have ‘different’ beliefs.” Pssh.
In general I agree with your post, and while Pat’s is an argument I could imagine someone saying to me, I don’t let this overwrite my models. If I think that person X has good meta-rationality, and you suggest my evidence is bad according to one particular outsid view, I will not throw away my models, but keep them while I examine this argument. If the argument is compelling I’ll update, but the same heuristic that keeps me from preventing bucket errors will also stop me from immediatley saying anything like “Yes, you’re probably right that I don’t really have evidence of X’s meta-rationality being strong”.
I think if anything in his review set off my instinct that I had to write “https://thezvi.wordpress.com/2017/11/27/you-have-the-right-to-think/″ (which is sitting at −1 here which I’m sad about, but it got great discussion on my blog itself, which I think combines to valuable feedback on many levels that I’m still processing, and I’m thankful for people’s candor).
The first part is an absurd Isolated Demand for Rigor, in violation of any reasonable rules of good writing and of common sense. Experts never seem to need to prove any of that stuff, but suddenly Eliezer’s book is supposed to stop to provide expert-approved outside-view proof for the idea that being better at thinking and avoiding mistakes might make one better at thinking and avoiding mistakes. Magnitude is a legitimate question, but come on. You’re not allowed to use evidence of your meta-rationality that isn’t approved by the licensing court, or something? And even if the eivdence is blatant and outside view-approved you need to present all of it yourself explicitly?
The second half then says something that keeps being claimed and simply isn’t true: That you have to be ‘more meta-rational’ or otherwise superior to others who have beliefs, in some way in order to have an opinion (to think) on something. Otherwise, your object-level evidence needs to be thrown out (in his comments he said multiple times no, don’t throw out your object-level evidence, that’s obviously wrong, but what else would it mean not to be able to judge?) This is insane. You don’t need that at all. You just need to be good enough that your observations and analysis aren’t zeroed out and fully priced in by the experts, which is a much lower bar. You could easily have different data, apply more compute, or do any number of other things, and even if you don’t your likelihood ratio isn’t going to be 1.
Whole thing is super frustrating.
#TheOppositeOfDeepAdviceIsAlsoDeepAdvice.
Robin Hanson: “You are never entitled to your own beliefs” i.e. there are rules of reasoning about evidence and is you state probabilities that are inconsistent with the evidence you’ve seen you’re lying.
Zvi: “You are entitled to your own beliefs” i.e. there are many many MANY social pressures pushing for you to cast aside the evidence you’ve noticed for dissenting ideas, in favour of socially modest beliefs. Resist these pressures, for they are taking away your very right to think! (#LetsAssumeRightsExist)
And thus, a community deep in the first phrase, reacted poorly to the second. I admit, until I read the comment section of your post, I had not been able to at all form the charitable and correct reading of your post.
(And yeah, the comments there are awesome.)
If/when I point to empirical evidence that practising using bayes’ theorem does in fact help your meta-rationality, my model of Pat Modesto says “Oh, so you claim that you have ‘empirical’ evidence and this means you know ‘better’ than others. Many people thought they too had ‘special’ evidence that allowed them to have ‘different’ beliefs.” Pssh.
In general I agree with your post, and while Pat’s is an argument I could imagine someone saying to me, I don’t let this overwrite my models. If I think that person X has good meta-rationality, and you suggest my evidence is bad according to one particular outsid view, I will not throw away my models, but keep them while I examine this argument. If the argument is compelling I’ll update, but the same heuristic that keeps me from preventing bucket errors will also stop me from immediatley saying anything like “Yes, you’re probably right that I don’t really have evidence of X’s meta-rationality being strong”.