I see the loss of control argument. Regarding the argument of being dominated: to what extent is being dominated by a superpower with ASI different from being dominated by a superpower with nuclear weapons, conventional military dominance, and economic dominance, which is the current situation for many middle powers? I can imagine that post-ASI, control granularity might be higher, and permanence might be higher. How important will these differences be?
control granularity might be higher, and permanence might be higher
That’s pretty much it, just to an extreme extent. Given that ASI could be extremely powerful and that it’s really hard to predict what it could do, I recommend thinking of it as:
The control granularity is basically infinite (the state can read your mind, persuade you to take arbitrary actions, predict what you’ll do long in advance, etc.)
The permanence is basically infinite (eg. until the heat death of the universe)
I see the loss of control argument. Regarding the argument of being dominated: to what extent is being dominated by a superpower with ASI different from being dominated by a superpower with nuclear weapons, conventional military dominance, and economic dominance, which is the current situation for many middle powers? I can imagine that post-ASI, control granularity might be higher, and permanence might be higher. How important will these differences be?
That’s pretty much it, just to an extreme extent. Given that ASI could be extremely powerful and that it’s really hard to predict what it could do, I recommend thinking of it as:
The control granularity is basically infinite (the state can read your mind, persuade you to take arbitrary actions, predict what you’ll do long in advance, etc.)
The permanence is basically infinite (eg. until the heat death of the universe)
Agree. Guess granularity will be a function of AI power.