I think decision-makers will take life extension into account just about exactly when they take existential risk into account. They are both fairly obvious implications of taking RSI and ASI seriously.
I think the second point is crucial and equally important to the main point. I think actually most humans in charge of ASI would produce very good futures in the long term. Unfortunately their political enemies are probably the absolute worst off in the short term so perhaps that doesn’t matter for the game theory from the leaders perspective. But it matters a lot for the group will, which might matter for electing or otherwise choosing a leader.
I am hoping we elect a next US president who both takes alignment x-risk seriously and who takes the possibility of cooperating with China seriously. That’s one reason I think it’s timely to hammer out this logic now.
I think decision-makers will take life extension into account just about exactly when they take existential risk into account. They are both fairly obvious implications of taking RSI and ASI seriously.
I think the second point is crucial and equally important to the main point. I think actually most humans in charge of ASI would produce very good futures in the long term. Unfortunately their political enemies are probably the absolute worst off in the short term so perhaps that doesn’t matter for the game theory from the leaders perspective. But it matters a lot for the group will, which might matter for electing or otherwise choosing a leader.
I am hoping we elect a next US president who both takes alignment x-risk seriously and who takes the possibility of cooperating with China seriously. That’s one reason I think it’s timely to hammer out this logic now.