Good point! For the record, insofar as we attempt to build aligned AIs by doing the moral equivalent of “breeding a slave-race”, I’m pretty uneasy about it. (Whereas insofar as it’s more the moral equivalent of “a child’s values maturing”, I have fewer moral qualms. As is a separate claim from whether I actually expect that you can solve alignment that way.) And I agree that the morality of various methods for shaping AI-people are unclear. Also, I’ve edited the post (to add a “at least according to my ideals” clause) to acknowledge the point that others might be more comfortable with attempting to align AI-people via means that I’d consider morally dubious.
Good point! For the record, insofar as we attempt to build aligned AIs by doing the moral equivalent of “breeding a slave-race”, I’m pretty uneasy about it. (Whereas insofar as it’s more the moral equivalent of “a child’s values maturing”, I have fewer moral qualms. As is a separate claim from whether I actually expect that you can solve alignment that way.) And I agree that the morality of various methods for shaping AI-people are unclear. Also, I’ve edited the post (to add a “at least according to my ideals” clause) to acknowledge the point that others might be more comfortable with attempting to align AI-people via means that I’d consider morally dubious.