I have found that this can be hacked in innumerable ways. The simplest one might be the lottery hack: imagine vividly awesome things that’d happen conditional on something nearly impossible happening, and just hide that impossibility from your brain, for example using scope sensitivity. What’d you do if a mayor banks computer got a random bitflip giving you 2^20 dollars? What’d you do if you suddenly transformed into a magical unicorn with a purple tentacle?
I have found that this can be hacked in innumerable ways. The simplest one might be the lottery hack: imagine vividly awesome things that’d happen conditional on something nearly impossible happening, and just hide that impossibility from your brain, for example using scope sensitivity. What’d you do if a mayor banks computer got a random bitflip giving you 2^20 dollars? What’d you do if you suddenly transformed into a magical unicorn with a purple tentacle?