One point I notice here is that “value” is in the map, not the territory. The whole notion that agents have values is a way of modeling real-world things; it isn’t a principle on which the world rests.
For instance, people sometimes make big, definitive-sounding claims about “human terminal values”, but these are basically (pretty rough) attempts to create a map that might be useful for predicting human behavior. Insofar as that map isn’t predictive, it’s worth amending or discarding.
One point I notice here is that “value” is in the map, not the territory. The whole notion that agents have values is a way of modeling real-world things; it isn’t a principle on which the world rests.
For instance, people sometimes make big, definitive-sounding claims about “human terminal values”, but these are basically (pretty rough) attempts to create a map that might be useful for predicting human behavior. Insofar as that map isn’t predictive, it’s worth amending or discarding.