I suspect the terminology we use shapes the discussions we have.
We have X-Risk for extinction, and S-risk for Roko’s basilisk torturing us all.
What is the common way of referring to the thing we were all terrified of in the late 20th century, namely that corporations and government would finally get together and work out a way to oppress everyone for all of time.
I want a universally comprehensible way of writing sentences like “Stable Diffusion increases X-risk by accelerating AI development, but decreases 1984-Risk by making it less likely that AI will be centrally controlled”.
Totalitarianism seems to work just fine. If you want a shorthand for that, perhaps you can write T-risk.
Perhaps U+1984 or ᦄ-Risk
“Risk of stable totalitarianism” is the term I’ve seen.
Nick Bostrom has a taxonomy of different existential risks which would refer to this class of things as ‘shrieks’
It certainly seems like it fits in that category.
1984-Risk is clear and concise, I don’t think we’ll do better.
Caplan called it the “totalitarian threat”
O-risk, in deference to Orwell.
I do believe Huxley’s Brave New World is a far more likely future dystopia than Orwell’s. 1984 is too tied to its time of writing.