(e.g., a Manhattan Project, “CERN for AI,” a large international coalition that shares all IP, etc), or relying on a single dominant actor (i.e., the US government) developing overwhelming (and potentially AI-powered) military supremacy and using it to enforce the relevant norms.
Whoa, these things are extremely different from each other in the relevant dimension:
US government dominance of AGI & AGI Manhattan Project are both extreme concentrations of power, yes. I’m terrified of them too.
But CERN for AI… doesn’t seem nearly that bad? What, are you thinking CERN will use their AIs to take over the world? It’s possible, I suppose, but that would require every government that joined together to create CERN to be asleep at the wheel. Presumably the various governments would have various forms of oversight into the CERN for AGI project, and would monitor its developments, etc.
And a large international coalition sharing all IP? How on earth is that concentrating power? Isn’t that pretty similar to mandating that all AI be open-sourced, which is the paradigmatic example of spreading out the power?
Whoa, these things are extremely different from each other in the relevant dimension:
US government dominance of AGI & AGI Manhattan Project are both extreme concentrations of power, yes. I’m terrified of them too.
But CERN for AI… doesn’t seem nearly that bad? What, are you thinking CERN will use their AIs to take over the world? It’s possible, I suppose, but that would require every government that joined together to create CERN to be asleep at the wheel. Presumably the various governments would have various forms of oversight into the CERN for AGI project, and would monitor its developments, etc.
And a large international coalition sharing all IP? How on earth is that concentrating power? Isn’t that pretty similar to mandating that all AI be open-sourced, which is the paradigmatic example of spreading out the power?