Concern #1 Why should we assume the AI wants to survive? If it does, then what exactly wants to survive?
I recommend Rob Miles’s video on instrumental convergence, which contains an answer to this. It’s only 10 minutes. He probably explains this as well as anyone here. If you do watch it, I’d be interested to hear your thoughts.
I recommend Rob Miles’s video on instrumental convergence, which contains an answer to this. It’s only 10 minutes. He probably explains this as well as anyone here. If you do watch it, I’d be interested to hear your thoughts.
I’m supprised that intrumental convergence wasn’t covered in the book. I didn’t even notice it was left out untill reading this review.
Here’s some alternative sources in anyone prefeers text over video:
https://www.lesswrong.com/w/instrumental-convergence
https://en.wikipedia.org/wiki/Instrumental_convergence