I also don’t have a solution besides reminding the rationalists that we run on corrupted hardware, and the strong feeling of “these people around me are idiots, I could do it hundred times better” is an evolutionary adaptation for situations when there are many resources and no significant external enemy. (And by the way, this could explain a lot of individualism our society has these days.) We had a few people here who got offended e.g. by Eliezer’s certainty about quantum physics, and tried to split, and failed.
So perhaps the risk is actually small. Fake rationalists may be prone to self-sabotage. The proverbial valley of the bad rationality surrounding the castle of rationality can make being a half-rationalist even worse than being a non-rationalist. So the rationalists may have a hard time fighting pure superstition, but the half-rationalists will just conveniently destroy themselves.
The first mover advantage works best if all players are using the same strategy. But sometimes the new player can learn from older players’ mistakes, and does not have to pay the costs. (Google wasn’t the first search engine; Facebook wasn’t the first social network; MS Windows wasn’t the first operating system with graphical interface.) The second player could learn from LW’s bad PR. But it is likely that being completely irrational would be even more profitable for them, if profit would be the main goal.
I also don’t have a solution besides reminding the rationalists that we run on corrupted hardware, and the strong feeling of “these people around me are idiots, I could do it hundred times better” is an evolutionary adaptation for situations when there are many resources and no significant external enemy. (And by the way, this could explain a lot of individualism our society has these days.) We had a few people here who got offended e.g. by Eliezer’s certainty about quantum physics, and tried to split, and failed.
So perhaps the risk is actually small. Fake rationalists may be prone to self-sabotage. The proverbial valley of the bad rationality surrounding the castle of rationality can make being a half-rationalist even worse than being a non-rationalist. So the rationalists may have a hard time fighting pure superstition, but the half-rationalists will just conveniently destroy themselves.
The first mover advantage works best if all players are using the same strategy. But sometimes the new player can learn from older players’ mistakes, and does not have to pay the costs. (Google wasn’t the first search engine; Facebook wasn’t the first social network; MS Windows wasn’t the first operating system with graphical interface.) The second player could learn from LW’s bad PR. But it is likely that being completely irrational would be even more profitable for them, if profit would be the main goal.