Of all the peoples’ lives that exist and have existed, what are the chances I’m living [...here and now]
Is there a more charitable interpretation of this line of thinking rather than “My soul selected this particular body out of all available”?
You being you as you are is a product of your body developing in circumstances it happened to develop in.
“Hard problem of corrigibility” refers to Problem of fully updated deference—Arbital, which uses a simplification (human preferences can be described as a utility function) that can be inappropriate for the problem. Human preferences are obviously path-dependent (you don’t want to be painfully disassembled and reconstituted as a perfectly happy person with no memory of disassembly). Was appropriateness of the above simplification discussed somewhere?