True WBE with amplification (the last two entries on your scale) is almost inevitable going to produce a society with a large degree of inequality between the most amplified WBEs and everyone else. Humans are not perfectly aligned to other humans (see https://www.lesswrong.com/s/QypaioYFd3CMFhefn/p/4gGGu2ePkDzgcZ7pf for more discussion), and history has demonstrated at great length that human societies with high levels of inequality rarely treat the less-powerful members of the society well. So WBE with enhancement is itself (even without other AGI) a major alignment/power concentration risk. So I think the blue line on your first graph is too optimistic (or you need two such lines, one for inherent risks and one for benefits). So I think your argument actually understates the case for your conclusions.
(I mostly wanted to just leave this question aside, in order to make the argument modularized from this question. I agree there’s a significant risk, though maybe I think it’s less than you think there is and/or more worth it to prevent AGI.)
True WBE with amplification (the last two entries on your scale) is almost inevitable going to produce a society with a large degree of inequality between the most amplified WBEs and everyone else. Humans are not perfectly aligned to other humans (see https://www.lesswrong.com/s/QypaioYFd3CMFhefn/p/4gGGu2ePkDzgcZ7pf for more discussion), and history has demonstrated at great length that human societies with high levels of inequality rarely treat the less-powerful members of the society well. So WBE with enhancement is itself (even without other AGI) a major alignment/power concentration risk. So I think the blue line on your first graph is too optimistic (or you need two such lines, one for inherent risks and one for benefits). So I think your argument actually understates the case for your conclusions.
(I mostly wanted to just leave this question aside, in order to make the argument modularized from this question. I agree there’s a significant risk, though maybe I think it’s less than you think there is and/or more worth it to prevent AGI.)