The dubiously friendly AI, instead of creating artificial significant others, merely uses its computational ability to figure out that if it breaks up all existing relationships and instead puts people together with new partners, then everyone would be happier. Again, it then separates everyone in such a way that the existing partners could not get together in a reasonable amount of time. (You couldn’t do complete sex segregation, but you could put several pairs together on the same planet as long as the particular people who you broke them up with are on other planets.) Utopia or not?
And is it good or bad? There’s more than one objection to the original scenario and the point of this is 1) to separate them out, and 2) to make them more obvious.
Let’s modify the scenario a bit.
The dubiously friendly AI, instead of creating artificial significant others, merely uses its computational ability to figure out that if it breaks up all existing relationships and instead puts people together with new partners, then everyone would be happier. Again, it then separates everyone in such a way that the existing partners could not get together in a reasonable amount of time. (You couldn’t do complete sex segregation, but you could put several pairs together on the same planet as long as the particular people who you broke them up with are on other planets.) Utopia or not?
OK, I acknowledge receipt of this modified scenario.
And… what?
And is it good or bad? There’s more than one objection to the original scenario and the point of this is 1) to separate them out, and 2) to make them more obvious.