Related question: What is the purpose of taking into consideration the preferences of people NOT around to deal with the AI?
The dead and the potential-future-people, not to mention the people of other possible worlds, haven’t got any say in anything that happens now in this world. This is because it is physically impossible for us (people in the present of this possible world) to find out what those preferences are. At best, we can only guess and extrapolate.
Unless the AI has the ability to find out those preferences, it ought to weigh currently our preferences more heavily because of that additional certainty.
Why take into account the preferences of anyone other than the builders of the AI, other than via the fact that those builders may care about those other creatures?
Related question: What is the purpose of taking into consideration the preferences of people NOT around to deal with the AI?
The dead and the potential-future-people, not to mention the people of other possible worlds, haven’t got any say in anything that happens now in this world. This is because it is physically impossible for us (people in the present of this possible world) to find out what those preferences are. At best, we can only guess and extrapolate.
Unless the AI has the ability to find out those preferences, it ought to weigh currently our preferences more heavily because of that additional certainty.
Why take into account the preferences of anyone other than the builders of the AI, other than via the fact that those builders may care about those other creatures?