ETA: your “don’t be evil” looks like a confusion of levels to me. If you don’t want to be evil, there’s already a term for that in your volition—no need to add any extra precautions.
Eliezer didn’t realize that you meant his own personal CEV, rather than his current incoherent, unextrapolated volition.
Eliezer didn’t realize that you meant his own personal CEV, rather than his current incoherent, unextrapolated volition.