Large mindspace does not by itself imply problems for CEV.
The obvious way for CEV to converge is for people to compromise and cooperate on some joint utility function rather than try to conquer those they disagree with. Historical trends suggest increasing cooperation. As long as that continues, coherent agreements about volition will become easier if human thought is extrapolated first.
Large mindspace does not by itself imply problems for CEV.
The obvious way for CEV to converge is for people to compromise and cooperate on some joint utility function rather than try to conquer those they disagree with. Historical trends suggest increasing cooperation. As long as that continues, coherent agreements about volition will become easier if human thought is extrapolated first.
Small mindspaces would make CEV easier, so large mindspaces have to be a problem at some level.
CEV is an algorithm, not a continuation of historical trends. Getting the algorithm right might make use of stuff like those trends, though.
The “if we knew more” part of CEV sure sounds like a continuation of historical trends.