It’s the level of detail that’s the real risk. Sora or Veo would generate motion video and audio, bringing even more false life into the counterfactual. People get emotionally attached to characters in movies; imagine trying not to form attachments to interactive videos of your own counterfactual children who call you “Mom” or “Dad”. Your dead friend or relative could emotionally-believably talk to you from beyond the grave.
That’s the kind of thing only the ultra-rich could have conceived of having someone fabricate for them in the past, and it would have come with at least some checks and balances. Now kids in elementary school can necromance their dead parent or whatever.
Realistically, I think it will become “normal” to have your counterfactual worlds easily accessible in this way and the new generations will simply adapt and develop internal safeguards against getting exploited by it, much like we learn how to deal with realistic dreams. I honestly don’t know about the rest of us hitting it later in adulthood.
Now kids in elementary school can necromance their dead parent or whatever.
Ouch! I just imagine those crazy people who want to post on Less Wrong about discovering the true nature of consciousness… but in my imagination, they are also teenagers, and their dead parents (impersonated by chatgpt) keep telling them: “you are going to be a great scientist, you just have to believe in yourself”.
It’s the level of detail that’s the real risk. Sora or Veo would generate motion video and audio, bringing even more false life into the counterfactual. People get emotionally attached to characters in movies; imagine trying not to form attachments to interactive videos of your own counterfactual children who call you “Mom” or “Dad”. Your dead friend or relative could emotionally-believably talk to you from beyond the grave.
That’s the kind of thing only the ultra-rich could have conceived of having someone fabricate for them in the past, and it would have come with at least some checks and balances. Now kids in elementary school can necromance their dead parent or whatever.
Realistically, I think it will become “normal” to have your counterfactual worlds easily accessible in this way and the new generations will simply adapt and develop internal safeguards against getting exploited by it, much like we learn how to deal with realistic dreams. I honestly don’t know about the rest of us hitting it later in adulthood.
Ouch! I just imagine those crazy people who want to post on Less Wrong about discovering the true nature of consciousness… but in my imagination, they are also teenagers, and their dead parents (impersonated by chatgpt) keep telling them: “you are going to be a great scientist, you just have to believe in yourself”.