Tiiba—I believe Nate’s suggesting that part of the reason non-rationalists feel hostile towards rationalists could be that they fear the rationalists are not rationalists at all, but Clever Arguers.
That is, they fear that a superior intelligence is attempting to manipulate their beliefs through rationalization.
How easily would you be able to distinguish between a fAI trying to help you discover the truth and an unfriendly AI concocting a clever argument to lead you to the conclusion it (for whatever reason) wants for you, assuming both are vastly more intelligent than you?
Tiiba—I believe Nate’s suggesting that part of the reason non-rationalists feel hostile towards rationalists could be that they fear the rationalists are not rationalists at all, but Clever Arguers.
That is, they fear that a superior intelligence is attempting to manipulate their beliefs through rationalization.
How easily would you be able to distinguish between a fAI trying to help you discover the truth and an unfriendly AI concocting a clever argument to lead you to the conclusion it (for whatever reason) wants for you, assuming both are vastly more intelligent than you?