Even with zero knowledge of the other guy’s function, you’d always start with Lie #1: Always represent any outcome that leaves you worse off as having infinite negative utility (or at least more bad than your utopia point is good).
This cuts off any outcome that decreases your utility, and thus is very, very good for you—even if you need to self-modify and make it real. Note that this is how actual negotiations work.
Another easy hack is to limit your goals, and pretend that impossibly good outcomes are no better for you than the best possible outcome, in order to increase the value of utility to you via decreasing your Utopia point.
Even with zero knowledge of the other guy’s function, you’d always start with Lie #1: Always represent any outcome that leaves you worse off as having infinite negative utility (or at least more bad than your utopia point is good).
This cuts off any outcome that decreases your utility, and thus is very, very good for you—even if you need to self-modify and make it real. Note that this is how actual negotiations work.
Another easy hack is to limit your goals, and pretend that impossibly good outcomes are no better for you than the best possible outcome, in order to increase the value of utility to you via decreasing your Utopia point.