Consensus seems to be that there is no fire alarm for artificial intelligence. We may see the smoke and think nothing of it. But at what point do we acknowledge that the fire has entered the room? To be less euphemistic, what would have to happen to convince you that a human-level AGI has been created?
I ask this because it isn’t obvious to me that there is any level of evidence which would convince many people, at least not until the AGI is beyond human levels. Even then, it may not be clear to many that superintelligence has actually been achieved. For instance, I can easily imagine the following hypothetical scenario:
A future GPT-N which scores a perfect 50% on a digital Turing Test (meaning nobody can detect if a sample output is written by humans or GPT-N), is announced by OpenAI. Let’s imagine they do the responsible thing and don’t publicly release the API. My intuition is that most people will not enter panic mode at that point, but will either:
Assume that this is merely some sort of publicity stunt, with the test being artificially rigged in some way.
Say something like “yes, it passed the Turing test, but that doesn’t really count because [insert reason x], and even if it did, that doesn’t mean it will be generalizable to domains outside of [domain y that GPT-N is believed to lie inside of].”
Claim that being a good conversationalist does not fully capture what it means to be intelligent, and thereby dismiss the news as being yet another step in the long road towards “true” AGI.
The next week, OpenAI announces that the same model has solved a massive open problem in mathematics, something that a number of human mathematicians had previously claimed wouldn’t be solved this century. I predict a large majority of people (though probably few in the rationalist community) would not view this as being indicative of AGI, either.
The next week, GPT-N+1 escapes, and takes over the world. Nobody has an opinion on this, because they’re all dead.
This thought experiment leads me to ask: at what point would you be convinced that human-level AGI has been achieved? What about superhuman AGI? Additionally, at what point would you expect the average (non-rationalist) AI researcher to accept that they’ve created an AGI?
I think a Turing test grounded in something visual would be very convincing to me and many other people.
I.e. not just the ability to to do small talk or talk about things that have been discussed extensively on the internet, but to talk sensibly about a soccer game in progress, a live chess game, a movie that is shown for the first time, a fictional map of a subway system, a painting, reality TV, etc.
I think visual grounding would cut out a lot of faking.
Some “superpowers” are an existential risk, such as designing a virus that quickly kills all humans.
Some “superpowers” are horrifying on a System 1 level, but not actually an existential risk; like building dozen giant robots that will stomp on buildings and destroy a few cities, but will ultimately be destroyed by an army.
If we get lucky and the AI develops and uses the latter kind of “superpowers” first, we might get scared before we die.
Easy answers first: the average AI researcher will accept it when others do.
When the preponderance of evidence is heavily weighted in this direction. In one simple class of scenario this would involve unprecedented progress in areas limited by things like human attention, memory, io bandwidth, etc. Some of these would likely not escape public attention. But there are a lot of directions AGI can go.
Could you give a specific hypothetical if you have the time? What would be a specific example of a scenario that you’d look at and go “welp, that’s AGI!” Asking since I can imagine most individual accomplishments being brushed away as “oh, guess that was easier than we thought”