I think that moral realism is true, but species-specific. Morality is basically what being a social species feels like from the inside. To be able to live together, group members need to behave morally towards each other; if too many don’t, their society falls apart. But our human morality is different from what it would be if we were more like e.g. lions or naked mole rats. If we create an AGI, it will be its own species. Will it be a social species, and will it see us as their in-group?
And for species that is not social, morality would mostly reduce to game theory, as most ways you interact with other members of your species is fighting for territory or food. (Exceptions: sex, maybe taking care of your kids.)
I think that moral realism is true, but species-specific. Morality is basically what being a social species feels like from the inside. To be able to live together, group members need to behave morally towards each other; if too many don’t, their society falls apart. But our human morality is different from what it would be if we were more like e.g. lions or naked mole rats. If we create an AGI, it will be its own species. Will it be a social species, and will it see us as their in-group?
And for species that is not social, morality would mostly reduce to game theory, as most ways you interact with other members of your species is fighting for territory or food. (Exceptions: sex, maybe taking care of your kids.)