I don’t think he’d make a strong claim about that, but I wouldn’t be surprised if he assigned that possibility significant credence. I assign that possibility relatively low credence. I assign much more credence to the position that we’ll never need to solve the problem of designing a human-friendly superintelligent goal-directed agent.
So what is he saying? We never need to solve the problem of designing a human-friendly superintelligent agent?
I don’t think he’d make a strong claim about that, but I wouldn’t be surprised if he assigned that possibility significant credence. I assign that possibility relatively low credence. I assign much more credence to the position that we’ll never need to solve the problem of designing a human-friendly superintelligent goal-directed agent.