Rules will not support development of powerful AGI as it might threaten to overpower them
is probably true, but only because you used the word “powerful” rather than “capable”. Rulers would definitely want development of capable AGIs as long as they believe (however incorrectly) in their ability to maintain power/control over those AGIs.
In fact, rulers are likely to be particularly good at cultivating capable underlings they they maintain firm control of. It may cause them to overestimate their ability to do the same for AGI. In fact, if they expect an AGI to be less agentic, they might expect it to actually be easier to maintain control over an “we just program it to obey” AGI, and prefer that over what they perceive to be inherently less predictable humans.
is probably true, but only because you used the word “powerful” rather than “capable”. Rulers would definitely want development of capable AGIs as long as they believe (however incorrectly) in their ability to maintain power/control over those AGIs.
In fact, rulers are likely to be particularly good at cultivating capable underlings they they maintain firm control of. It may cause them to overestimate their ability to do the same for AGI. In fact, if they expect an AGI to be less agentic, they might expect it to actually be easier to maintain control over an “we just program it to obey” AGI, and prefer that over what they perceive to be inherently less predictable humans.