I mean, yeah. For a while now I’ve thought that the “takeoff” will consist not of rogue AI making war on humanity, but of AI-empowered companies and governments becoming stronger and more callous (at least toward most people, who are no longer needed for success). After all AIs and companies/governments share the same convergent instrumental goals, namely the goal to grow in power, so an alliance or merge between them makes perfect sense. The end result is just as bad though.
I do believe gradual disempowerment to be a real risk, although I don’t think the incentives for automating human labour will result in the damage stopping there.
I mean, yeah. For a while now I’ve thought that the “takeoff” will consist not of rogue AI making war on humanity, but of AI-empowered companies and governments becoming stronger and more callous (at least toward most people, who are no longer needed for success). After all AIs and companies/governments share the same convergent instrumental goals, namely the goal to grow in power, so an alliance or merge between them makes perfect sense. The end result is just as bad though.
I do believe gradual disempowerment to be a real risk, although I don’t think the incentives for automating human labour will result in the damage stopping there.