Funny, when talking to Patrick at the workshop I made pretty much the opposite point. Maybe worth spelling it out here, since I came up with Lobian cooperation in the first place:
The PD over modal agents is just another game-theoretic problem. As the zoo of proposed modal agents grows, our failure to find a unique “rational” modal agent is a reflection of our inability to find a unique “rational” strategy in an arbitrary game. Waging war on an established result is typically a bad idea, we probably won’t roll back the clock on game theory and reduce n-player to 1-player. This particular game is still worth investigating, but I don’t hope to find any unique notion of rationality in there.
Without a unique notion of rationality, it seems premature to say that rational agents won’t play a game in a certain way. Who knows what limitations they might have? For example, PrudentBot based on PA will defect against PrudentBot based on PA+1.
Funny, when talking to Patrick at the workshop I made pretty much the opposite point. Maybe worth spelling it out here, since I came up with Lobian cooperation in the first place:
The PD over modal agents is just another game-theoretic problem. As the zoo of proposed modal agents grows, our failure to find a unique “rational” modal agent is a reflection of our inability to find a unique “rational” strategy in an arbitrary game. Waging war on an established result is typically a bad idea, we probably won’t roll back the clock on game theory and reduce n-player to 1-player. This particular game is still worth investigating, but I don’t hope to find any unique notion of rationality in there.
Without a unique notion of rationality, it seems premature to say that rational agents won’t play a game in a certain way. Who knows what limitations they might have? For example, PrudentBot based on PA will defect against PrudentBot based on PA+1.