Upvoted as a good re-explanation of CEV complexity in simpler terms! (I believe LW will benefit from recalling the long understood things so that it has a chance on predicting future in greater detail.)
That said, current wishes of many people include things they want being done faster and easier; it’s just the more you extrapolate the less fraction wants that level of automation—just more divergence as you consider higher scale.
I suppose it does. That article was not in my mind at the time, but, well, let’s just say that I am not a total hedonistic utilitarian, or a utilitarian of any other stripe. “Pleasure” is not among my goals, and the poster’s vision of a universe of hedonium is to me one type of dead universe.
Upvoted as a good re-explanation of CEV complexity in simpler terms! (I believe LW will benefit from recalling the long understood things so that it has a chance on predicting future in greater detail.)
In essence, you prove the claim “Coherent Extrapolated Volition would not literally include everything desirable happening effortlessly and everything undesirable going away”. Would I be wrong to guess it argues against position in https://www.lesswrong.com/posts/AfAp8mEAbuavuHZMc/for-the-sake-of-pleasure-alone?
That said, current wishes of many people include things they want being done faster and easier; it’s just the more you extrapolate the less fraction wants that level of automation—just more divergence as you consider higher scale.
I suppose it does. That article was not in my mind at the time, but, well, let’s just say that I am not a total hedonistic utilitarian, or a utilitarian of any other stripe. “Pleasure” is not among my goals, and the poster’s vision of a universe of hedonium is to me one type of dead universe.