Wasn’t this fact roughly the underlying motivation for rushing to the singularity, at least for a lot of people before the stark risks became clear? I think there are still several arguments that the risk of extinction is small (most species go extinct) against the potential for solving so much suffering (which, incidentally, is also removed by extinction). Certainly leaning toward negative utilitarianism.
Now we have to grapple with the tradeoff of solving suffering vs. risking extinction. Personally, I might be okay with x-risk if many-worlds AND P(s-risk) / P(x-risk) ~= 0.
Wasn’t this fact roughly the underlying motivation for rushing to the singularity, at least for a lot of people before the stark risks became clear? I think there are still several arguments that the risk of extinction is small (most species go extinct) against the potential for solving so much suffering (which, incidentally, is also removed by extinction). Certainly leaning toward negative utilitarianism.
Now we have to grapple with the tradeoff of solving suffering vs. risking extinction. Personally, I might be okay with x-risk if many-worlds AND P(s-risk) / P(x-risk) ~= 0.