I’ve always interpreted power concentration to be adjacent to loss of control, as only AI decision-making autonomy differs between them. I.e. AIs in LoC AIs are just a bit more confident when selecting goals compared to PC AIs, as they defer to humans in PC but don’t in LoC.
So, do you think PC isn’t a realistic threat model because you think it can easily devolve into LoC? Or do you think PC necessitates an oxymoronic AI that both has ultimate decision-making ability (as it must if it were to accomplish the millions of subtasks concentrating power necessitates) and ultimate deference (remains loyal to a much less intelligent being. Or your qualm with PC something else?
I’ve always interpreted power concentration to be adjacent to loss of control, as only AI decision-making autonomy differs between them. I.e. AIs in LoC AIs are just a bit more confident when selecting goals compared to PC AIs, as they defer to humans in PC but don’t in LoC.
So, do you think PC isn’t a realistic threat model because you think it can easily devolve into LoC? Or do you think PC necessitates an oxymoronic AI that both has ultimate decision-making ability (as it must if it were to accomplish the millions of subtasks concentrating power necessitates) and ultimate deference (remains loyal to a much less intelligent being. Or your qualm with PC something else?