Yes, people are not strategically altruistic, but they are not strategically selfish, too. Most people do not optimize the world ruthlessly towards selfishly-better outcomes, like, they don’t donate to AI notkilleveryoneism and life-extension research, while not being dead is valuable for self-interest. I think if more people become more strategic (using augmentation from AIs, for example), they will become more altruistic and if they create sentient slaves in the meantime they are likely to have “WHAT HAVE I DONE” moment.
Some percentage of people other and dehumanize actual humans so as to enable them to literally enslave them without feeling the guilt it should create. We are in an adversarial environment and should not pretend otherwise. A significant portion of people capable of creating suffering beings would be amused by their suffering. Humanity contains unusually friendly behavior patterns in the animal kingdom and when those behavior patterns manifest in the best way it can create remarkably friendly interaction networks, but we also contain genes that, combined with the right memes, serve to suppress any “what have I done” about a great many atrocities.
It’s not necessarily implemented as deep planning selfishness, that much is true. But that doesn’t mean it’s not a danger. Orthogonality applies to humans too.
Yes, people are not strategically altruistic, but they are not strategically selfish, too. Most people do not optimize the world ruthlessly towards selfishly-better outcomes, like, they don’t donate to AI notkilleveryoneism and life-extension research, while not being dead is valuable for self-interest. I think if more people become more strategic (using augmentation from AIs, for example), they will become more altruistic and if they create sentient slaves in the meantime they are likely to have “WHAT HAVE I DONE” moment.
[edit: pinned to profile]
Some percentage of people other and dehumanize actual humans so as to enable them to literally enslave them without feeling the guilt it should create. We are in an adversarial environment and should not pretend otherwise. A significant portion of people capable of creating suffering beings would be amused by their suffering. Humanity contains unusually friendly behavior patterns in the animal kingdom and when those behavior patterns manifest in the best way it can create remarkably friendly interaction networks, but we also contain genes that, combined with the right memes, serve to suppress any “what have I done” about a great many atrocities.
It’s not necessarily implemented as deep planning selfishness, that much is true. But that doesn’t mean it’s not a danger. Orthogonality applies to humans too.