People were scared of nuclear weapons since 1945, but no one restricted the arms race until The Cuban Missile Crisis in 1961.
We know for sure that the crisis really scared both Soviet and US high commands, and the first document to restrict nukes was signed the next year, 1962.
What kind of fire alarm it might be? That is The Question.
I think we’ll get some more scares from systems like autoGPT. Watching an AI think to itself, in English, is going to be powerful. And when someone hooks one up to an unturned model and asks it to think about whether and how to take over the world, I think we’ll get another media event. For good reasons.
I think actually making such systems, while the core LLM is still too dumb to actually succeed at taking over the world, might be important.
I totally agree that it might be good to have such a fire alarm as soon as possible, and looking at how fast people make GPT-4 more and more powerful makes me think that this is only a matter of time.
I believe we need a fire alarm.
People were scared of nuclear weapons since 1945, but no one restricted the arms race until The Cuban Missile Crisis in 1961.
We know for sure that the crisis really scared both Soviet and US high commands, and the first document to restrict nukes was signed the next year, 1962.
What kind of fire alarm it might be? That is The Question.
I think we’ll get some more scares from systems like autoGPT. Watching an AI think to itself, in English, is going to be powerful. And when someone hooks one up to an unturned model and asks it to think about whether and how to take over the world, I think we’ll get another media event. For good reasons.
I think actually making such systems, while the core LLM is still too dumb to actually succeed at taking over the world, might be important.
I totally agree that it might be good to have such a fire alarm as soon as possible, and looking at how fast people make GPT-4 more and more powerful makes me think that this is only a matter of time.