The only ways to prevent Mythos-level open models would need to happen in China. Nobody but China is likely to produce a Mythos-level open model.
There are two main ways this might not happen:
The Chinese companies may decide to keep their most powerful models private as training costs go up. GitHub’s recent decision to resell Chinese open models near the frontier may also annoy the companies which make those models, in much the same way that AWS repacking open source software annoys the companies that created it and tried to sell their own hosting services.
The Chinese government may independently start to worry about the capabilities of Mythos-class models and impose regulation of their own.
One of the complicating factors here is that Anthropic and OpenAI are preparing for the largest rent extraction in the history of the human race, and they represent a massive risk of concentration of power. (That power might be effectively seized by the government, but it’s likely to remain concentrated.)
So there will be strong advocates for open models, including open frontier-adjacent models, in order to fight what looks like epic-level rent extraction and power concentration risks.
US regulation, by itself, will accomplish exactly nothing, because Europe would happily use cheap, open Chinese models to avoid losing control to US labs and to avoid paying enormous rent.
I find this whole logic deeply frustrating, because the logic pushes everyone involved towards racing. And while Mythos isn’t an ASI-level threat, I don’t know how many more breakthroughs and scale-ups we can get away with before we start facing loss-of-control risks.
The only ways to prevent Mythos-level open models would need to happen in China. Nobody but China is likely to produce a Mythos-level open model.
There are two main ways this might not happen:
The Chinese companies may decide to keep their most powerful models private as training costs go up. GitHub’s recent decision to resell Chinese open models near the frontier may also annoy the companies which make those models, in much the same way that AWS repacking open source software annoys the companies that created it and tried to sell their own hosting services.
The Chinese government may independently start to worry about the capabilities of Mythos-class models and impose regulation of their own.
One of the complicating factors here is that Anthropic and OpenAI are preparing for the largest rent extraction in the history of the human race, and they represent a massive risk of concentration of power. (That power might be effectively seized by the government, but it’s likely to remain concentrated.)
So there will be strong advocates for open models, including open frontier-adjacent models, in order to fight what looks like epic-level rent extraction and power concentration risks.
US regulation, by itself, will accomplish exactly nothing, because Europe would happily use cheap, open Chinese models to avoid losing control to US labs and to avoid paying enormous rent.
I find this whole logic deeply frustrating, because the logic pushes everyone involved towards racing. And while Mythos isn’t an ASI-level threat, I don’t know how many more breakthroughs and scale-ups we can get away with before we start facing loss-of-control risks.