But more immediately than that, if AI Doomer lobbyists and activists … succeed in convincing the U.S. government that AI is the key to the future of all humanity and is too dangerous to be left to private companies, the U.S. government will not simply regulate AI to a halt. Instead, the U.S. government will do what it has done every time it’s been convinced of the importance of a powerful new technology in the past hundred years: it will drive research and development for military purposes
I said exactly this in the comments on Max Tegmark’s post...
“If you are in the camp that assumes that you will be able to safely create potent AGI in a contained lab scenario, and then you’d want to test it before deploying it in the larger world… Then there’s a number of reasons you might want to race and not believe that the race is a suicide race.
Some possible beliefs downstream of this:
My team will evaluate it in the lab, and decide exactly how dangerous it is, without experiencing much risk (other than leakage risk).
We will test various control methods, and won't deploy the model on real tasks until we feel confident that we have it sufficiently controlled. We are confident we won't make a mistake at this step and kill ourselves.
We want to see empirical evidence in the lab of exactly how dangerous it is. If we had this evidence, and knew that other people we didn't trust were getting close to creating a similarly powerful AI, this would guide our policy decisions about how to interact with these other parties. (E.g. what treaties to make, what enforcement procedures would be needed, what red lines would need to be drawn).
I said exactly this in the comments on Max Tegmark’s post...
“If you are in the camp that assumes that you will be able to safely create potent AGI in a contained lab scenario, and then you’d want to test it before deploying it in the larger world… Then there’s a number of reasons you might want to race and not believe that the race is a suicide race.
Some possible beliefs downstream of this:
″
https://www.lesswrong.com/posts/oJQnRDbgSS8i6DwNu/the-hopium-wars-the-agi-entente-delusion?commentId=ssDnhYeHJCLCcCk3x