In some sense, human values are just convergent instrumental goals: survival, pleasure, status and replication. Any other agent will converge to similar goals. This creates the attractor in the space of values.
The difference is that we want that AI will care about our survival, not AI’s survival etc.
In some sense, human values are just convergent instrumental goals: survival, pleasure, status and replication. Any other agent will converge to similar goals. This creates the attractor in the space of values.
The difference is that we want that AI will care about our survival, not AI’s survival etc.