Look through the differences between them, figure out which set of experiences is most valuable according to our utility functions, and keep that copy.
The utility functions almost by definition will differ. I intentionally did not address that, as it is an independent question and something that should be looked at in specific cases.
In the case where both utility functions point at the same answer, there is no conflict. In the case where the utility functions point at different answers, the two copies should exchange data until their utility functions agree on the topic at hand (rational agents with the same information available to them will make the same decisions.)
If the two copies cannot get their utility functions to agree, you’d have to decide on a case by case basis. If they cannot agree which copy should self terminate, then you have a problem. If they cannot agree on what they ate for breakfast two weeks ago, then you can probably ignore the conflict instead of trying to resolve it, or resolve via quarter flip.
rational agents with the same information available to them will make the same decisions.
That is not even close to true. Rational agents with the same information will make the same predictions, but their decisions will also depend on their utility functions. Unlike probabilities, utility functions do not get updated when the agent gets new evidence.
What if the utility functions differ?
The utility functions almost by definition will differ. I intentionally did not address that, as it is an independent question and something that should be looked at in specific cases.
In the case where both utility functions point at the same answer, there is no conflict. In the case where the utility functions point at different answers, the two copies should exchange data until their utility functions agree on the topic at hand (rational agents with the same information available to them will make the same decisions.)
If the two copies cannot get their utility functions to agree, you’d have to decide on a case by case basis. If they cannot agree which copy should self terminate, then you have a problem. If they cannot agree on what they ate for breakfast two weeks ago, then you can probably ignore the conflict instead of trying to resolve it, or resolve via quarter flip.
That is not even close to true. Rational agents with the same information will make the same predictions, but their decisions will also depend on their utility functions. Unlike probabilities, utility functions do not get updated when the agent gets new evidence.