AI can potentially lead to a government bureaucracy loyal to whomever has control of the models training or prompting, ensuring an army of agents that will not leak, whistleblow, or disobey an illegal order.
This is a good point. But it’s also so close to a point that I was wishing you’d make around how similar AI is to bureaucracy in many respects. There’ve been some solid papers on this, especially irt Max Weber theory of bureaucracy. But key points of comparison include: both operate in ways that skews the picture of moral responsibility for humans; both act almost like machines that cannot be stopped; both have an impersonal element that may look like impartiality, but that may fail to account for the dignity and respect due to the people they impact.
Careful. Government doesn’t have a monopoly on violence—government has a monopoly on the legitimate use of force. (That’s Weber again.) The term “legitimate” is doing a lot of work here.