A possible solution to this: The person who does not want to try sushi thinks he will dislike it and say “Yuck!” He actually enjoys it. He is wrong in that he anticipated something different from what happened. A person who does not want to wirehead will anticipate enjoying it immensely, and this will be accurate. The first person’s decision to try to avoid sushi is based on a mistaken anticipation, but the second person’s decision to avoid wireheading takes into account a correct anticipation.
A possible solution to this: The person who does not want to try sushi thinks he will dislike it and say “Yuck!” He actually enjoys it. He is wrong in that he anticipated something different from what happened. A person who does not want to wirehead will anticipate enjoying it immensely, and this will be accurate. The first person’s decision to try to avoid sushi is based on a mistaken anticipation, but the second person’s decision to avoid wireheading takes into account a correct anticipation.