I think you only have a problem if everyone is a perfectly selfless agent. In fact, a room with many of you and one of me would not only be well defined, but probably be very useful according to my ethics.
Those are just “copies” of me; they’re already accounted for. But now you’ve got an entire room of me insisting you aren’t allowed to be 100% utilitarian. We have a secret method of detecting copies of us, which is why we’re singling you out. Also, we act differently so you don’t get freaked out by an obvious hive mind presence. That would just be creepy. Even by my standards. (Get it? “My” standards? Ah forget it...)
I think you only have a problem if everyone is a perfectly selfless agent. In fact, a room with many of you and one of me would not only be well defined, but probably be very useful according to my ethics.
Those are just “copies” of me; they’re already accounted for. But now you’ve got an entire room of me insisting you aren’t allowed to be 100% utilitarian. We have a secret method of detecting copies of us, which is why we’re singling you out. Also, we act differently so you don’t get freaked out by an obvious hive mind presence. That would just be creepy. Even by my standards. (Get it? “My” standards? Ah forget it...)