Manfred, what about quantum computers? They can be big enough to have a goal system, and will work only when their states are coherent… Will they generate a new kind of morality?
If you can care about a quantum computer, then the quantum computer will generate no new kind of morality by caring about itself.
Sure, it puts is in an unusual position—but the goal of this post was to show that this position isn’t qualitatively different, jsut something we haven’t had much reason to care about yet.
Manfred, what about quantum computers? They can be big enough to have a goal system, and will work only when their states are coherent… Will they generate a new kind of morality?
If you can care about a quantum computer, then the quantum computer will generate no new kind of morality by caring about itself.
Sure, it puts is in an unusual position—but the goal of this post was to show that this position isn’t qualitatively different, jsut something we haven’t had much reason to care about yet.