I can see why you’d criticize someone for saying “the problem is that the setting wasn’t formal enough” but that’s not exactly what I was getting at. What I was getting at is that there’s a limit to how much thinking that one can do in a day, everyone’s limit is different, and a lot of people do things to ration their brainpower so they avoid running out of it. This comment on mental stamina explains more.
My point was, more clearly worded: It would be a very rare person who possesses enough mental stamina to be rational in literally every single situation. That’s a wonderful ideal, but the reality is that most people are going to ration brainpower. If your expectation is that rationalists should never ration brainpower and should be rational constantly, this is an unrealistic expectation. A more realistic expectation is that people should identify the things they need to think extra hard about, and correctly use rational thinking skills at those times. Therefore, testing for the skills when they’re trying is probably the only way to detect a difference. There are inevitably going to be times when they’re not trying very hard, and if you catch them at one of those times, well, you’re not going to see rational thinking skills. It may be that some of these things can be ingrained in ways that don’t use up a person’s mental stamina, but to expect that rationality can be learned in such a way that it is applied constantly strikes me as an unreasoned assumption.
Now I wonder if the entire difference between the control groups results and LessWrong’s results was that Yvain asked the control group only one question, whereas LessWrong had answered 14 pages of questions prior to that.
Agreed that rationality is mentally tiring...I went back and read your comment, too. However:
A more realistic expectation is that people should identify the things they need to think extra hard about, and correctly use rational thinking skills at those times.
To me, rationality is mostly the ability to notice that “whew, this is a problem that wasn’t in the problem-set of the ancestral environment, therefore my intuitions probably won’t be useful and I need to think”. The only way a rationalist would have to be analytical all the time is if they were very BAD at doing this, and had to assume that every situation and problem required intense thought. Most situations don’t. In order to be an efficient rationalist, you have to be able to notice which situations do.
Any question on a written test isn’t a great measure of real-life rationality performance, but there are plenty of situations in everyday life when people have to make decisions based on some unknown quantities, and would benefit from being able to calibrate exactly how much they do know. Some people might answer better on the written test than if faced with a similar problem in real life, but I think it’s unlikely that anyone would do worse on the test than in real life.
Re having to think all the time: a good start is to develop a habit of rejecting certainty about judgments and beliefs that you haven’t examined sufficiently (that is, if your intuition shouts at you that something is quite clear, but you haven’t thought about that for a few minutes, ignore that intuition unless you have a reliable reason to not ignore it in that case). If you don’t have stamina or incentives to examine such beliefs/judgments in more detail, that’s all right, as long as you remain correspondingly uncertain, and realize that the decisions you make might be suboptimal for that reason (which should suitably adjust your incentives for thinking harder, depending on the importance of the decisions).
I can see why you’d criticize someone for saying “the problem is that the setting wasn’t formal enough” but that’s not exactly what I was getting at. What I was getting at is that there’s a limit to how much thinking that one can do in a day, everyone’s limit is different, and a lot of people do things to ration their brainpower so they avoid running out of it. This comment on mental stamina explains more.
My point was, more clearly worded: It would be a very rare person who possesses enough mental stamina to be rational in literally every single situation. That’s a wonderful ideal, but the reality is that most people are going to ration brainpower. If your expectation is that rationalists should never ration brainpower and should be rational constantly, this is an unrealistic expectation. A more realistic expectation is that people should identify the things they need to think extra hard about, and correctly use rational thinking skills at those times. Therefore, testing for the skills when they’re trying is probably the only way to detect a difference. There are inevitably going to be times when they’re not trying very hard, and if you catch them at one of those times, well, you’re not going to see rational thinking skills. It may be that some of these things can be ingrained in ways that don’t use up a person’s mental stamina, but to expect that rationality can be learned in such a way that it is applied constantly strikes me as an unreasoned assumption.
Now I wonder if the entire difference between the control groups results and LessWrong’s results was that Yvain asked the control group only one question, whereas LessWrong had answered 14 pages of questions prior to that.
Agreed that rationality is mentally tiring...I went back and read your comment, too. However:
To me, rationality is mostly the ability to notice that “whew, this is a problem that wasn’t in the problem-set of the ancestral environment, therefore my intuitions probably won’t be useful and I need to think”. The only way a rationalist would have to be analytical all the time is if they were very BAD at doing this, and had to assume that every situation and problem required intense thought. Most situations don’t. In order to be an efficient rationalist, you have to be able to notice which situations do.
Any question on a written test isn’t a great measure of real-life rationality performance, but there are plenty of situations in everyday life when people have to make decisions based on some unknown quantities, and would benefit from being able to calibrate exactly how much they do know. Some people might answer better on the written test than if faced with a similar problem in real life, but I think it’s unlikely that anyone would do worse on the test than in real life.
Re having to think all the time: a good start is to develop a habit of rejecting certainty about judgments and beliefs that you haven’t examined sufficiently (that is, if your intuition shouts at you that something is quite clear, but you haven’t thought about that for a few minutes, ignore that intuition unless you have a reliable reason to not ignore it in that case). If you don’t have stamina or incentives to examine such beliefs/judgments in more detail, that’s all right, as long as you remain correspondingly uncertain, and realize that the decisions you make might be suboptimal for that reason (which should suitably adjust your incentives for thinking harder, depending on the importance of the decisions).