Holden does a great job but makes two major flaws: 1) His argument about Tool-AI is irrelevant, because creating Tool-AI does almost nothing to avoid Agent-AI, which he agrees is dangerous. 2) He too narrowly construes SI’s goals by assuming they are only working on Friendly AI rather than AGI x-risk reduction in general.
Holden does a great job but makes two major flaws:
1) His argument about Tool-AI is irrelevant, because creating Tool-AI does almost nothing to avoid Agent-AI, which he agrees is dangerous.
2) He too narrowly construes SI’s goals by assuming they are only working on Friendly AI rather than AGI x-risk reduction in general.