I have thought a lot about this. Possible reasons: most humans don’t care about the far future or people who are not yet born, most things that seem absurd are absurd and are not worth investigating and the singularity certainly superficially seems absurd, the vast majority is right and you and I are incorrect to worry about a singularity, it’s impossible for people to imagine an intelligence AI that doesn’t have human-like emotions, the Fermi paradox implies that civilizations such as ours are not going to be able to rationally think about the far future, and an ultra-AI would be a god and so is disallowed by most peoples’ religious beliefs.
Your question is related to why so few signup for cryonics.
I agree with you that a lot of people think that way, but I have spoken to quite a few smart people who understand all the points—I probe to figure out if there are any major inferential gaps—and they still don’t get on the bandwagon.
Another point is simply that we cannot all devote time to all important things; they simply choose not to prioritize this.
I have thought a lot about this. Possible reasons: most humans don’t care about the far future or people who are not yet born, most things that seem absurd are absurd and are not worth investigating and the singularity certainly superficially seems absurd, the vast majority is right and you and I are incorrect to worry about a singularity, it’s impossible for people to imagine an intelligence AI that doesn’t have human-like emotions, the Fermi paradox implies that civilizations such as ours are not going to be able to rationally think about the far future, and an ultra-AI would be a god and so is disallowed by most peoples’ religious beliefs.
Your question is related to why so few signup for cryonics.
I don’t know about anyone else, but I find it hard to believe that provable Friendliness is possible.
On the other hand, I think high-probability Friendliness might be possible.
I agree with you that a lot of people think that way, but I have spoken to quite a few smart people who understand all the points—I probe to figure out if there are any major inferential gaps—and they still don’t get on the bandwagon.
Another point is simply that we cannot all devote time to all important things; they simply choose not to prioritize this.