A quick nitpick:
You say:
The executive order was intended to limit various risks from AI… none of which were at all related to human extinction, except maybe bioweapons.
But note this from the EO:
(k) The term “dual-use foundation model” means an AI model that is trained on broad data; generally uses self-supervision; contains at least tens of billions of parameters; is applicable across a wide range of contexts; and that exhibits, or could be easily modified to exhibit, high levels of performance at tasks that pose a serious risk to security, national economic security, national public health or safety, or any combination of those matters, such as by:
...(iii) permitting the evasion of human control or oversight through means of deception or obfuscation.
Michael Kratsios strikes me as the person most worth keeping an eye on in terms of Trump’s potential AI policy