This is way, way, off. CEV isn’t a magic tool that makes people have preferences that we consider ‘sane’. People really do have drastically different preferences. Value is fragile.
I wholeheartedly agree. It boggles my mind that people think they can predict what CEV would want, let alone CEV.
What distinguishes Hitler from other people in the arguments about the goodness of CEV’s output?
Something must be known to decide that CEV is better than random noise, and the relevant distinctions between different people are the distinctions you can use to come to different conclusions about quality of CEV’s output. What you don’t know isn’t useful to discern the right answer, only what you do know can be used, even if almost nothing is known.
I wholeheartedly agree. It boggles my mind that people think they can predict what CEV would want, let alone CEV.
What distinguishes Hitler from other people in the arguments about the goodness of CEV’s output?
Something must be known to decide that CEV is better than random noise, and the relevant distinctions between different people are the distinctions you can use to come to different conclusions about quality of CEV’s output. What you don’t know isn’t useful to discern the right answer, only what you do know can be used, even if almost nothing is known.