If you don’t think moral realism is worth getting hang up on for AI and are interested in implications on AI development and AIs steering the future, then I’d recommend the last two posts in my sequence (8 and 9 in the summary I linked above). And maybe the 7th post as well (it’s quite short) since it serves as a recap of some things that will help you better follow the reasoning in post 9.
What you write in that “Moral realism” section of your other post seems reasonable! I was surprised to read that you don’t necessarily expect moral realism to apply because I thought the framing at the start of your post here (“Morality is unsolved”) suggested a moral realist outlook (because it read to me as though written by someone who expects there to be a solution). I would have maybe added something like ”… and we don’t even seem to agree on solution criteria,” after the message “Morality is unsolved,” to highight the additional uncertainty about metaethics.
That said, after re-reading, I see now that, later on, you say “We also don’t understand metaethics well”.
(Sorry for the late reply.)
If you don’t think moral realism is worth getting hang up on for AI and are interested in implications on AI development and AIs steering the future, then I’d recommend the last two posts in my sequence (8 and 9 in the summary I linked above). And maybe the 7th post as well (it’s quite short) since it serves as a recap of some things that will help you better follow the reasoning in post 9.
What you write in that “Moral realism” section of your other post seems reasonable! I was surprised to read that you don’t necessarily expect moral realism to apply because I thought the framing at the start of your post here (“Morality is unsolved”) suggested a moral realist outlook (because it read to me as though written by someone who expects there to be a solution). I would have maybe added something like ”… and we don’t even seem to agree on solution criteria,” after the message “Morality is unsolved,” to highight the additional uncertainty about metaethics.
That said, after re-reading, I see now that, later on, you say “We also don’t understand metaethics well”.