Do you devote a significant amount of your time and resources to making paperclips, given the possibility that you’re being simulated?
Keeping everyone alive would not take a significant amount of a paperclip maximizer’s time and resources. (Though for utilitarians this probably means it doesn’t count.) But the key difference is this: human-like goal systems seem like they will gain access to lots more simulation resources than paperclip maximizers or some other specific human-indifferent goal system (the set of all human-indifferent goal systems together is a different matter, but they’re not a coherent bloc).
Do you devote a significant amount of your time and resources to making paperclips, given the possibility that you’re being simulated?
Keeping everyone alive would not take a significant amount of a paperclip maximizer’s time and resources. (Though for utilitarians this probably means it doesn’t count.) But the key difference is this: human-like goal systems seem like they will gain access to lots more simulation resources than paperclip maximizers or some other specific human-indifferent goal system (the set of all human-indifferent goal systems together is a different matter, but they’re not a coherent bloc).