Such an ASI would be aware the Homo sapiens are omnivores, not innately vegan, and would not expect us to act with as much beneficence towards all other humans as it does, let alone act that way to all other animals.
Sure. My point isn’t that the AI will read this post and “judge” us based on how “good” we are. It’s that, at the end of the day it’s us creating the AI, and if we solve technical alignment we infuse our values, or more accurately, the values of whoever has the power to influence the process.
So it’s not that an AI couldn’t decide “I’m just going to do the best for humans, and all human-level entities, irregardless of how they treat each other or lower life-forms”. Anything is possible. The question is: What is likely to actually get built if the powerful get their hands on such a technology?
Sure. My point isn’t that the AI will read this post and “judge” us based on how “good” we are. It’s that, at the end of the day it’s us creating the AI, and if we solve technical alignment we infuse our values, or more accurately, the values of whoever has the power to influence the process.
So it’s not that an AI couldn’t decide “I’m just going to do the best for humans, and all human-level entities, irregardless of how they treat each other or lower life-forms”. Anything is possible. The question is: What is likely to actually get built if the powerful get their hands on such a technology?