This bit misses the point about predictability of goal-optimizing outcome without predictability of individual steps used to reach that outcome:
Now let’s get back to the earlier question of how powerful a computer the Predictor has. Here’s you, and here’s the Predictor’s computer. Now, you could base your decision to pick one or two boxes on anything you want. You could just dredge up some childhood memory and count the letters in the name of your first-grade teacher or something and based on that, choose whether to take one or two boxes. In order to make its prediction, therefore, the Predictor has to know absolutely everything about you. It’s not possible to state a priori what aspects of you are going to be relevant in making the decision. To me, that seems to indicate that the Predictor has to solve what one might call a “you-complete” problem. In other words, it seems the Predictor needs to run a simulation of you that’s so accurate it would essentially bring into existence another copy of you.
This bit misses the point about predictability of goal-optimizing outcome without predictability of individual steps used to reach that outcome: