No. Humans are not perfect moral reasoners; if he booted up a Friendly superintelligence and it mentioned black people, should a racist conclude he screwed up?
It’s unlikely, to my mind, that the arguments presented by the OP are correct—but they are not trivially false. There are people who already espouse similar views; hell, there are people who believe we should all commit suicide now, to spare future generations the pain of living. To simply say “I don’t want to do that” is a fully general counteragument, and if it was properly integrated you would be immune to any moral argument.
(You would also have to conclude that everyone but you has a wildly different utility function, which would rather defeat the purpose of CEV.)
No. Humans are not perfect moral reasoners; if he booted up a Friendly superintelligence and it mentioned black people, should a racist conclude he screwed up?
It’s unlikely, to my mind, that the arguments presented by the OP are correct—but they are not trivially false. There are people who already espouse similar views; hell, there are people who believe we should all commit suicide now, to spare future generations the pain of living. To simply say “I don’t want to do that” is a fully general counteragument, and if it was properly integrated you would be immune to any moral argument.
(You would also have to conclude that everyone but you has a wildly different utility function, which would rather defeat the purpose of CEV.)