Isn’t it just as scary (or more so) if they’re more like humans, with short-term goals and incoherent long-term ideals? Instrumental convergence is part of the argument of doom EVEN IF they have goals, they will take short-term actions to increase their power, at our expense. If they DON’T have goals, it seems likely they’ll STILL take actions which harm us.
Isn’t it just as scary (or more so) if they’re more like humans, with short-term goals and incoherent long-term ideals? Instrumental convergence is part of the argument of doom EVEN IF they have goals, they will take short-term actions to increase their power, at our expense. If they DON’T have goals, it seems likely they’ll STILL take actions which harm us.