Not many people consider GPT-4 extremely dangerous on its own. Hooking up something at that level of intelligence into a larger system with memory storage and other modules is a bit more threatening, and probably sufficient to do great harm already if wielded by malevolent actors unleashing it onto social media platforms, for example.
The real danger is that GPT-4 is a mile marker we’ve blown by on the road to ever more capable AI. At some point, likely before climate change becomes an existential threat, we lose control and that’s when things get really weird, unpredictable, and dangerous.
Eliezer has near-zero hope for humanity’s survival. I think we’d all agree that the universal agreement he suggests is not something plausible in the current world. He’s not advocating for it because he believes it might happen but rather it’s the only thing he thinks might be enough to give us a shot at survival.
Not many people consider GPT-4 extremely dangerous on its own. Hooking up something at that level of intelligence into a larger system with memory storage and other modules is a bit more threatening, and probably sufficient to do great harm already if wielded by malevolent actors unleashing it onto social media platforms, for example.
The real danger is that GPT-4 is a mile marker we’ve blown by on the road to ever more capable AI. At some point, likely before climate change becomes an existential threat, we lose control and that’s when things get really weird, unpredictable, and dangerous.
Eliezer has near-zero hope for humanity’s survival. I think we’d all agree that the universal agreement he suggests is not something plausible in the current world. He’s not advocating for it because he believes it might happen but rather it’s the only thing he thinks might be enough to give us a shot at survival.