That is a speculative prediction. And definitely not how most people (not least within the AI alignment community) talk about alignment.
Haven’t read the book (and thanks for the link!) but are they even arguing for more alignment research? Or just for a general slowdown/pause of development?
The book isn’t out yet, so you know as much as I do what’s in it, but the title is a big clue. I doubt if there will be much speculation in it, because I’m familiar with the authors’ writings over the years. What matters is not, who agrees with them, or how many, but, is it true? To open the book is to leave the outside view behind.
Short of absolute, superintelligent doom, there are also risks from easy access to bioweapon know-how, deepfakes rendering all news sources everywhere untrustworthy, chatbots crafted as propaganda tools, and everything that anyone can think of that just needs smarts on tap to pull off.
Smarts on tap is good! But it’s a general purpose tool that can be pointed in any direction.
Pharmaceuticals and school curricula present only “obvious” risks: those flowing directly and foreseeably from what they are.
That is a speculative prediction. And definitely not how most people (not least within the AI alignment community) talk about alignment.
Haven’t read the book (and thanks for the link!) but are they even arguing for more alignment research? Or just for a general slowdown/pause of development?
The book isn’t out yet, so you know as much as I do what’s in it, but the title is a big clue. I doubt if there will be much speculation in it, because I’m familiar with the authors’ writings over the years. What matters is not, who agrees with them, or how many, but, is it true? To open the book is to leave the outside view behind.
Short of absolute, superintelligent doom, there are also risks from easy access to bioweapon know-how, deepfakes rendering all news sources everywhere untrustworthy, chatbots crafted as propaganda tools, and everything that anyone can think of that just needs smarts on tap to pull off.
Smarts on tap is good! But it’s a general purpose tool that can be pointed in any direction.
Pharmaceuticals and school curricula present only “obvious” risks: those flowing directly and foreseeably from what they are.