I basically agree with this, and even more importantly I think any attempt to compress all the values of humanity as a collective will require you to put the thumb on the scale and infuse a lot of your own values, because there’s likely no ground truth on what the correct morality is, or even a consensus amongst humanity on what values are useful to them.
I think the defensible version of the sentence you quote is that it doesn’t matter that much for extinction risk issues, because failure here doesn’t lead to an entire species going extinct with any appreciable likelihood.
I basically agree with this, and even more importantly I think any attempt to compress all the values of humanity as a collective will require you to put the thumb on the scale and infuse a lot of your own values, because there’s likely no ground truth on what the correct morality is, or even a consensus amongst humanity on what values are useful to them.
I think the defensible version of the sentence you quote is that it doesn’t matter that much for extinction risk issues, because failure here doesn’t lead to an entire species going extinct with any appreciable likelihood.