After being initially impressed by this, I found one thing to pick at:
Reason 1: Mitigating AI risk could mitigate all other existential risks, but not vice-versa.
“Could” here tells you very little. The question isn’t whether “build FAI” could work as a strategy for mitigating all other existential risks, it’s whether that strategy has a good enough chance of working to be superior to other strategies for mitigating the other risks. What’s missing is an argument for saying “yes” to that second question.
After being initially impressed by this, I found one thing to pick at:
“Could” here tells you very little. The question isn’t whether “build FAI” could work as a strategy for mitigating all other existential risks, it’s whether that strategy has a good enough chance of working to be superior to other strategies for mitigating the other risks. What’s missing is an argument for saying “yes” to that second question.