Nice post! However, I think you’re missing a key quantity—the scale of interaction. If the benefits of cooperation are global (as they are in not building AI that kills everyone), assortative interactions do not solve the problem (there is no partner choice, spatial structure, etc. if the scale of effects of the behaviour of relevance are global). In this case some form of punishment, policing, reward, bargains outside the focal game etc. is needed to modify the payoff matrix to get cooperation.
Nice post! However, I think you’re missing a key quantity—the scale of interaction. If the benefits of cooperation are global (as they are in not building AI that kills everyone), assortative interactions do not solve the problem (there is no partner choice, spatial structure, etc. if the scale of effects of the behaviour of relevance are global). In this case some form of punishment, policing, reward, bargains outside the focal game etc. is needed to modify the payoff matrix to get cooperation.