This solves the preference to play—but doesn’t solve the preference to win/outcompete other humans. The only way to solve the preference to win is to create a nozick-experience-machine style existence where some of the players are actually NPCs that are indistinguishable from players [1] (The white chess players wins 80% of the time, but doesn’t understand that the black player is actually a bot). In any other scenario, it’s impossible to get a human to win without having another human to lose which means the preference to win will be thwarted on aggregate.
But for an FAI to spend vast amounts of free energy to create simulations of experience machines just seems wrong in a very fundamental sense, seems just like wireheading with extra steps.
[1] - This gives me the faint hope that we are already in this kind of scenario, meaning the 50 billion chickens we kill each year and the people that have a life that is best described as a living hell have no qualia. But unfortunately, I would have to bet against it.
Yes, there either have to be NPCs or a lot of real people have to lose. But that’s simply a mathematical constraint of actually playing against people like yourself. There’s enjoyment taken in the possibility of losing (and actually losing sometimes, seeing what went wrong).
This solves the preference to play—but doesn’t solve the preference to win/outcompete other humans. The only way to solve the preference to win is to create a nozick-experience-machine style existence where some of the players are actually NPCs that are indistinguishable from players [1] (The white chess players wins 80% of the time, but doesn’t understand that the black player is actually a bot). In any other scenario, it’s impossible to get a human to win without having another human to lose which means the preference to win will be thwarted on aggregate.
But for an FAI to spend vast amounts of free energy to create simulations of experience machines just seems wrong in a very fundamental sense, seems just like wireheading with extra steps.
[1] - This gives me the faint hope that we are already in this kind of scenario, meaning the 50 billion chickens we kill each year and the people that have a life that is best described as a living hell have no qualia. But unfortunately, I would have to bet against it.
Yes, there either have to be NPCs or a lot of real people have to lose. But that’s simply a mathematical constraint of actually playing against people like yourself. There’s enjoyment taken in the possibility of losing (and actually losing sometimes, seeing what went wrong).