The question of whose rightness gets to go into the AI still arises, and I don’t think that the solution you have outlined is really up to the task of producing a notion of rightness that everyone on the planet agrees with.
That’s not what CEV is for. It’s for not taking over the world, or if you prefer, not being a jerk, to the maximum extent possible. The maximum extent impossible is not really on the table.
I would endorse a more limited effort which focused on recreating the most commonly accepted values our society: namely rational western values.
That’s not what CEV is for. It’s for not taking over the world, or if you prefer, not being a jerk, to the maximum extent possible. The maximum extent impossible is not really on the table.
Then you have very little perspective on your place in history, my dear savage barbarian child.
That ain’t a narrow AI problem and you ain’t doin’ it with no narrow AI.
My metaethics is real and objective, just not universal. Fixed computations are objective, and at least halfway real.