I think you have to specify which policy you mean. First, let’s for now focus on regulation that’s really aiming to stop AGI, at least until safety is proven (if possible), not on regulation that’s only focusing on slowing down (incremental progress).
I see roughly three options: software/research, hardware, and data. All of these options would likely need to be global to be effective (that’s complicating things, but perhaps a few powerful states can enforce regulation on others—not necessarily unrealistic).
Most people who talk about AGI regulation seem to mean software or research regulation. An example is the national review board proposed by Musk. A large downside of this method is that, if it turns out that scaling up current approaches is mostly all that’s needed, Yudkowsky’s argument that a few years later, anyone can build AGI in their basement (unregulatable) because of hardware progress seems like a real risk.
A second option not suffering from this issue is hardware regulation. The thought experiment of Yudkuwsky that an AGI might destroy all CPUs in order to block competitors, is perhaps its most extreme form. One nod less extreme, chip capability could be forcibly held at either today’s capability level, or even at a level of some safe point in the past. This could be regulated at the fabs, which are few and not easy to hide. Regulating compute has also been proposed by Jaan Tallinn in a Politico newsletter, where he proposes regulating flops/km2.
Finally, an option could be to regulate data access. I can’t recall a concrete proposal but it should be possible in principle.
I think a paper should urgently be written about which options we have, and especially what the least economically damaging, but still reliable and enforcible regulation method is. I think we should move beyond the position that no regulation could do this—there are clearly options with >0% chance (depending strongly on coordination and communication) and we can’t afford to waste them.
I think you have to specify which policy you mean. First, let’s for now focus on regulation that’s really aiming to stop AGI, at least until safety is proven (if possible), not on regulation that’s only focusing on slowing down (incremental progress).
I see roughly three options: software/research, hardware, and data. All of these options would likely need to be global to be effective (that’s complicating things, but perhaps a few powerful states can enforce regulation on others—not necessarily unrealistic).
Most people who talk about AGI regulation seem to mean software or research regulation. An example is the national review board proposed by Musk. A large downside of this method is that, if it turns out that scaling up current approaches is mostly all that’s needed, Yudkowsky’s argument that a few years later, anyone can build AGI in their basement (unregulatable) because of hardware progress seems like a real risk.
A second option not suffering from this issue is hardware regulation. The thought experiment of Yudkuwsky that an AGI might destroy all CPUs in order to block competitors, is perhaps its most extreme form. One nod less extreme, chip capability could be forcibly held at either today’s capability level, or even at a level of some safe point in the past. This could be regulated at the fabs, which are few and not easy to hide. Regulating compute has also been proposed by Jaan Tallinn in a Politico newsletter, where he proposes regulating flops/km2.
Finally, an option could be to regulate data access. I can’t recall a concrete proposal but it should be possible in principle.
I think a paper should urgently be written about which options we have, and especially what the least economically damaging, but still reliable and enforcible regulation method is. I think we should move beyond the position that no regulation could do this—there are clearly options with >0% chance (depending strongly on coordination and communication) and we can’t afford to waste them.