As someone who doesn’t support an AGI ban today, I think this is an excellent post on one of the biggest issues people are going to face if they succeed at passing a law, and in particular the point that companies will often be able to evade rules because it’s very hard to properly draw the line (this is especially true for words like AGI, as they refer to way too many distinct pictures) is a big reason I tend towards technical work over governance myself.
Indeed, it’s very possible that dealing with deceptively aligned AIs while trying to automate alignment is easier than getting companies to not abuse the rules.
Re “a big reason I tend towards technical work over governance myself”- yes! I am very grateful for those focusing on “actually solving the problem” rather than preparing for catastrophic events. I am sitting on the latter, yet my biggest hope for the future sits with people who work on the technical research side :).
As someone who doesn’t support an AGI ban today, I think this is an excellent post on one of the biggest issues people are going to face if they succeed at passing a law, and in particular the point that companies will often be able to evade rules because it’s very hard to properly draw the line (this is especially true for words like AGI, as they refer to way too many distinct pictures) is a big reason I tend towards technical work over governance myself.
Indeed, it’s very possible that dealing with deceptively aligned AIs while trying to automate alignment is easier than getting companies to not abuse the rules.
Thank you! Curious to know what you think of the recent Global Call for AI Red Lines—Signed by Nobel Laureates, Former Heads of State, and 200+ Prominent Figures put forward by CeSIA. It is not an “AGI ban”, nor does it actually propose concrete red lines- it just demands that such red lines are agreed upon by global leaders.
Re “a big reason I tend towards technical work over governance myself”- yes! I am very grateful for those focusing on “actually solving the problem” rather than preparing for catastrophic events. I am sitting on the latter, yet my biggest hope for the future sits with people who work on the technical research side :).