“Are there morally justified terminal (not instrumental) values, that don’t causally root in the evolutionary history of value instincts?”
Such a morality should confer survival benefit. E.g., a tit-for-tat strategy.
Suppose an entity is greedy. It tries to garner all resources. In one-on-one competitions against weaker enties it thrives. But other entities see it as a major threat. A stronger entity will eliminate it. A group of weaker entities will cooperate to eliminate it.
A super intelligent AI might deduce or discover that other powerful entities exist in the universe and that they will adjust their behavior based on the AI’s history. The AI might see some value in displaying non-greedy behavior to competing entities. I.e., it might let humanity have a tiny piece of the universe if it increases the chance that the AI will also be allowed its own piece of the universe.
Optimal survival strategy might be a basis for moral behavior that is not rooted in evolutionary biology. Valued behaviors might be cooperation, trade, self restraint, limited reprisal, consistency, honesty, or clear signaling of intention.
“Are there morally justified terminal (not instrumental) values, that don’t causally root in the evolutionary history of value instincts?”
Such a morality should confer survival benefit. E.g., a tit-for-tat strategy.
Suppose an entity is greedy. It tries to garner all resources. In one-on-one competitions against weaker enties it thrives. But other entities see it as a major threat. A stronger entity will eliminate it. A group of weaker entities will cooperate to eliminate it.
A super intelligent AI might deduce or discover that other powerful entities exist in the universe and that they will adjust their behavior based on the AI’s history. The AI might see some value in displaying non-greedy behavior to competing entities. I.e., it might let humanity have a tiny piece of the universe if it increases the chance that the AI will also be allowed its own piece of the universe.
Optimal survival strategy might be a basis for moral behavior that is not rooted in evolutionary biology. Valued behaviors might be cooperation, trade, self restraint, limited reprisal, consistency, honesty, or clear signaling of intention.