I think any FAI-generated [e]utopia worth calling one would have to allow safe self-modification abilities and the right to choose one’s own fun, so you have little to worry about in this respect. Though if things go well, there’ll be forms of fun available to us (both wireheady/sensory and externally-motivated fun) that are orders of magnitude better than any you can imagine now; I support your right to scratch as many itches and listen to as much recent popular music as you want indefinitely into the future, and any FAI should as well, but you probably won’t actually keep wanting to do all of these for very long.
I think the future will be more complex than that. The fact that unbounded fun will be available to me points to the hypothesis that at some moment a revolutionary modification of our body-mind structure will be necessary.
but you probably won’t actually keep wanting to do all of these for very long.
The original post was stating clearly that I could possibly will. And to please not encode your skepticism into an AI :)
I think any FAI-generated [e]utopia worth calling one would have to allow safe self-modification abilities and the right to choose one’s own fun, so you have little to worry about in this respect. Though if things go well, there’ll be forms of fun available to us (both wireheady/sensory and externally-motivated fun) that are orders of magnitude better than any you can imagine now; I support your right to scratch as many itches and listen to as much recent popular music as you want indefinitely into the future, and any FAI should as well, but you probably won’t actually keep wanting to do all of these for very long.
I think the future will be more complex than that. The fact that unbounded fun will be available to me points to the hypothesis that at some moment a revolutionary modification of our body-mind structure will be necessary.
The original post was stating clearly that I could possibly will. And to please not encode your skepticism into an AI :)