“The U.S. government, and all other governments, should regulate the development of SMI [Superhuman Machine Intelligence],”
“The companies shouldn’t have to disclose how they’re doing what they’re doing (though when governments gets serious about SMI they are likely to out-resource any private company), but periodically showing regulators their current capabilities seems like a smart idea,”
“For example, beyond a certain checkpoint, we could require development [to] happen only on airgapped computers, require that self-improving software require human intervention to move forward on each iteration, require that certain parts of the software be subject to third-party code reviews, etc.,”
The regulations should mandate that the first SMI system can’t harm people, but it should be able to sense other systems becoming operational,
Further, he’d like to see funding for research and development flowing to organizations groups that agree to these rules.
This post makes an interesting argument for why it’d be a bad idea to regulate AI: you’d give people who are willing to skirt rules an advantage. LW wiki article. I suspect the AI community is best off creating its own regulatory structures and getting the government to give them power rather than hoping for competent government regulators.
Link from March that apparently hasn’t been discussed here: Y-Combinator’s Sam Altman thinks AI needs regulation:
“For example, beyond a certain checkpoint, we could require development [to] happen only on airgapped computers, require that self-improving software require human intervention to move forward on each iteration, require that certain parts of the software be subject to third-party code reviews, etc.,”
Sounds sensible.
This post makes an interesting argument for why it’d be a bad idea to regulate AI: you’d give people who are willing to skirt rules an advantage. LW wiki article. I suspect the AI community is best off creating its own regulatory structures and getting the government to give them power rather than hoping for competent government regulators.
More recent is his AMA. He answered a question about AI: https://www.reddit.com/r/IAmA/comments/3cudmx/i_am_sam_altman_reddit_board_member_and_president/csz46jc
He also wrote some stuff about AI on his blog (which turned out to be very controversial among readers.) I believe this is the source of your article:
http://blog.samaltman.com/machine-intelligence-part-1
http://blog.samaltman.com/machine-intelligence-part-2
Yeah, that quote was mentioned below and put me on a search for statements by Altman to this end.