Then what future would be not sad? The one where humans do have their place in life precisely because AI gods restrict themselves to protecting us from really important risks and to teaching us?
It’s sad because the AI partners in the story seem to be fake. Not fake because they’re AI, fake because they’re fiction. For example, it’s sad to fall in love with a character on character.ai because the LLM is simply roleplaying, it’s not really summoning the soul of Hatsune Miku or whoever. I assume the world models are the same; they’re basically experience machines.
This tells me that people might step into experience machines not because they don’t care about reality, but because they convince themselves the world inside is reality.
I agree that creating bespoke AI love interests that are fully sentient beings would have problems in its own right. Both scenarios are unsettling for different reasons.
I found it quite sad.
Then what future would be not sad? The one where humans do have their place in life precisely because AI gods restrict themselves to protecting us from really important risks and to teaching us?
It’s sad because the AI partners in the story seem to be fake. Not fake because they’re AI, fake because they’re fiction. For example, it’s sad to fall in love with a character on character.ai because the LLM is simply roleplaying, it’s not really summoning the soul of Hatsune Miku or whoever. I assume the world models are the same; they’re basically experience machines.
This tells me that people might step into experience machines not because they don’t care about reality, but because they convince themselves the world inside is reality.
Better that way. I wouldn’t want to give every person the ability to create a real person from spec, would you?
I agree that creating bespoke AI love interests that are fully sentient beings would have problems in its own right. Both scenarios are unsettling for different reasons.