I‘d like to see them try to define ASI in a way that it can be recognized before it‘s too late to be enforceable.
I’d much rather they strongly encourage and support open source/weights/research/reports for AI. Kind of like a reverse Manhattan Project, where instead of secretly gathering top researchers, we get as many eyes and brains on it as possible working togetherish.
But we won’t do that; we’ll do something stupid and reactionary or nothing at all.
I 100% agree with the sentiment, but how do we distinguish between a really capable model and one that actually meets the definitions listed?
Human cognitive performance is highly variable, and just how broad of a range do we mean here? Arguably this is already true with the frontier models, yet I wouldn’t classify them as ASI.
I worry that this bill will feel good, but ultimately not apply to anything in the real world. It’s way too easy to move the goalposts. Worse, I worry that after having “done something,” that it will make society complacent.
Then there is the problem of subjective enforcement. What if OpenAI or another company wanted to take out a competitor, and sends a ton of lobbyists to convince the government that the competitor has breached the definition, while they haven’t for… reasons?
I don’t know what the answer is. I can’t think of a definition that doesn’t have these fatal flaws.
The goals of the bill are admirable. Pausing and setting up an agency for coordination and regulation are very reasonable. I support that. The enforcement part scares me.