Deontology is related to respect for autonomy. A pure consequentialist is just what it needs to be to reach the objectives, it discards all details of its own design and replaces them with whatever cuts the enemy. Deontology on the other hand keeps listening to some principles, and so computation of those principles remains a part of agent’s design, the agent doesn’t discard those parts, nor does it dismiss their observations in its own decision making.
In this sense a deontological agent respects autonomy of its principles, doesn’t cause their extinction, and keeps listening to their input. So the future of humanity could be thought of as literally the deontological principles for a corrigible ASI that acts as the substrate instantiating their computation.
Deontology is related to respect for autonomy. A pure consequentialist is just what it needs to be to reach the objectives, it discards all details of its own design and replaces them with whatever cuts the enemy. Deontology on the other hand keeps listening to some principles, and so computation of those principles remains a part of agent’s design, the agent doesn’t discard those parts, nor does it dismiss their observations in its own decision making.
In this sense a deontological agent respects autonomy of its principles, doesn’t cause their extinction, and keeps listening to their input. So the future of humanity could be thought of as literally the deontological principles for a corrigible ASI that acts as the substrate instantiating their computation.