I think this has a fix-point selection problem: If one or both of them start with a different prior under which the other player punishes them for not racing / doesn’t reward them enough (maybe because they have very little faith in the other’s rationality, or because they think it’s not within their power to decide that, and also there’s not enough evidential correlation in their decisions), then they’ll race.
Of course, considerations about whether the other player normatively endorses something LDT-like also enter the picture. And even if individual humans would endorse it (and that’s already a medium-big if), I worry our usual decision structures (for example in AI labs) don’t incentivize it (and what’s the probability some convincing decision theorist cuts through them? not sure).
I think this has a fix-point selection problem: If one or both of them start with a different prior under which the other player punishes them for not racing / doesn’t reward them enough (maybe because they have very little faith in the other’s rationality, or because they think it’s not within their power to decide that, and also there’s not enough evidential correlation in their decisions), then they’ll race.
Of course, considerations about whether the other player normatively endorses something LDT-like also enter the picture. And even if individual humans would endorse it (and that’s already a medium-big if), I worry our usual decision structures (for example in AI labs) don’t incentivize it (and what’s the probability some convincing decision theorist cuts through them? not sure).