I tend not to believe that systems dependent on legible and consistent utility functions of other agents are not possible. If you’re thinking in terms of a negotiated joint utility function, you’re going to get gamed (by agents that have or appear to have extreme EV curves, so you have to deviate more than them). Think of it as a relative utility monster—there’s no actual solution to it.
I tend not to believe that systems dependent on legible and consistent utility functions of other agents are not possible. If you’re thinking in terms of a negotiated joint utility function, you’re going to get gamed (by agents that have or appear to have extreme EV curves, so you have to deviate more than them). Think of it as a relative utility monster—there’s no actual solution to it.