Roko, what exactly do you mean by “optimal”? “optimal” means “good”, which is another word for “ethical”, so your definition of ethics doesn’t actually tell us anything new!
An AI can view the supergoal of “creating more paperclips” as the optimal/correct/succesful/good thing to do.
the value of the AI’s supergoal(s) doesn’t has anything to do with it’s intelligence.
Roko, what exactly do you mean by “optimal”? “optimal” means “good”, which is another word for “ethical”, so your definition of ethics doesn’t actually tell us anything new! An AI can view the supergoal of “creating more paperclips” as the optimal/correct/succesful/good thing to do. the value of the AI’s supergoal(s) doesn’t has anything to do with it’s intelligence.