I second TGGP that the mention of wearing black etc. is ridiculous.
Lara: The portion you quote from Caledonian isn’t at all well-defined itself; it’s a near-pure insult hinting at, but not giving, actual arguments. I fully support its deletion. Also, Eliezer isn’t saying “keep on believing what you believe”, but “keep on following the process you have been”; he allows for moral error.
Lara, TGGP: The most important point is that building an AI, unlike surgery or dictatorship, doesn’t give you any power to be corrupted by—any opportunity to make decisions with short-term life-or-death results—until the task is complete, and shortly after that (for most goal systems, including Friendly ones) it’s out of your hands. Eliezer’s obvious awareness of rationalization is encouraging wrt not committing atrocities out of good intentions. CEV’s “Motivations” section, and CFAI FAQs 1.(2,3) and their references address correcting for partial programmer selfishness. Finally, I would think there would be more than one AI programmer, reducing the risk of deliberate evil.
Boris: See The Gift We Give To Tomorrow. Eliezer isn’t saying there’s some perfect function in the sky that evolution has magically led us to approximate. By “murder is wrong no matter whether I think it’s right or not”, he just means Eliezer-in-this-world judges that murder is still wrong in the counterfactual world where counterfactual-Eliezer judges that murder is right.
Richard: Eliezer thinks he can approximate the GHOST because the GHOST—his GHOST, more properly—is defined with respect to his own mind. Again, it’s not some light in the sky. He can’t, by definition, be twisted in such a way as to not be an approximation of his GHOST. And he obviously isn’t suggesting that anyone is infallible.
Eliezer: It seems to me that your point would be much more clear (like to Boris and Richard) if you would treat morality as a 2-place function: “I judge that murder is wrong even if...”, not “Murder is wrong even if...”. (Would you say Allan is right to call your position relativism?)
I second TGGP that the mention of wearing black etc. is ridiculous.
Lara: The portion you quote from Caledonian isn’t at all well-defined itself; it’s a near-pure insult hinting at, but not giving, actual arguments. I fully support its deletion. Also, Eliezer isn’t saying “keep on believing what you believe”, but “keep on following the process you have been”; he allows for moral error.
Lara, TGGP: The most important point is that building an AI, unlike surgery or dictatorship, doesn’t give you any power to be corrupted by—any opportunity to make decisions with short-term life-or-death results—until the task is complete, and shortly after that (for most goal systems, including Friendly ones) it’s out of your hands. Eliezer’s obvious awareness of rationalization is encouraging wrt not committing atrocities out of good intentions. CEV’s “Motivations” section, and CFAI FAQs 1.(2,3) and their references address correcting for partial programmer selfishness. Finally, I would think there would be more than one AI programmer, reducing the risk of deliberate evil.
Matt: See The “Intuitions” Behind “Utilitarianism”.
Boris: See The Gift We Give To Tomorrow. Eliezer isn’t saying there’s some perfect function in the sky that evolution has magically led us to approximate. By “murder is wrong no matter whether I think it’s right or not”, he just means Eliezer-in-this-world judges that murder is still wrong in the counterfactual world where counterfactual-Eliezer judges that murder is right.
Richard: Eliezer thinks he can approximate the GHOST because the GHOST—his GHOST, more properly—is defined with respect to his own mind. Again, it’s not some light in the sky. He can’t, by definition, be twisted in such a way as to not be an approximation of his GHOST. And he obviously isn’t suggesting that anyone is infallible.
Eliezer: It seems to me that your point would be much more clear (like to Boris and Richard) if you would treat morality as a 2-place function: “I judge that murder is wrong even if...”, not “Murder is wrong even if...”. (Would you say Allan is right to call your position relativism?)