You have an entire section titled “Human values as weak evidence”, which discusses how humans diverge from their evolutionary goals, but then you don’t address the obvious counterargument that an AI is not going to be a product of evolution, it will be the (indirect) product of a deliberate design process.
Why should a deliberately designed system work like one that has evolved?
You have an entire section titled “Human values as weak evidence”, which discusses how humans diverge from their evolutionary goals, but then you don’t address the obvious counterargument that an AI is not going to be a product of evolution, it will be the (indirect) product of a deliberate design process.
Why should a deliberately designed system work like one that has evolved?
I’m trying to get curious about which article you read.
I am not afraid to say “oops” and change my mind about replying to people who barely skimmed the headings.