I might be misunderstanding, but doesn’t this sort of assume that all tyranny is purely about resources?
No matter the level of abundance, its not clear that this makes power any less appealing to the power hungry, or suffering any less enjoyable to the sadists. So I don’t see why power-centralisation in the wrong hands would not be a problem in a post-AGI world.
Power-centralisation in a post-AGI world is not about wielding humans, unlike in a pre-AGI world. Power is no longer power over humans doing your bidding, because humans doing your bidding won’t give you power. By orthogonality, any terrible thing can in principle be someone’s explicit intended target (an aspiration, not just a habit shaped by circumstance), but that’s rare. Usually the terrible things are (a side effect of) an instrumentally useful course of action that has other intended goals, even where in the final analysis the justification doesn’t quite work.
I might be misunderstanding, but doesn’t this sort of assume that all tyranny is purely about resources?
No matter the level of abundance, its not clear that this makes power any less appealing to the power hungry, or suffering any less enjoyable to the sadists. So I don’t see why power-centralisation in the wrong hands would not be a problem in a post-AGI world.
Power-centralisation in a post-AGI world is not about wielding humans, unlike in a pre-AGI world. Power is no longer power over humans doing your bidding, because humans doing your bidding won’t give you power. By orthogonality, any terrible thing can in principle be someone’s explicit intended target (an aspiration, not just a habit shaped by circumstance), but that’s rare. Usually the terrible things are (a side effect of) an instrumentally useful course of action that has other intended goals, even where in the final analysis the justification doesn’t quite work.