“So at the end of the day, I embrace the principle: ‘Question your brain, question your intuitions, question your principles of rationality, using the full current force of your mind, and doing the best you can do at every point.’”
. . . to the extent that doing so increases your power, as illustrated by the principle you embrace to a greater extent:
“The point is to win.”
That’s the faith position.
“Everything, without exception, needs justification.”
. . . except that toward which justification is aimed: power.
“The important thing is to hold nothing back in your criticisms of how to criticize . . .”
Yet you do, as illustrated by your power, which is actually that toward which you are applying full force, playing to win. Rationalism is great to the extent it is empowering. To the extent it weakens us, we abandon it.
Eliezer, do you intend your use of “artificial intelligence” to be understood as always referencing something with human origins? What does it mean to you to place some artificial intelligences outside the scope of posthuman mindspace? Do you trust that human origins are capable of producing all possible artificial intelligences?