This is useful. As someone not familiar with decision theory, Newcomb’s problem was super confusing to me when I was asked to answer it (or rather, the point it).
Stupidly enough, I kept asking whether I should assume Omega is aligned or misaligned XD, “does it want me to get the lesser amount of money so that I don’t donate it to AI Safety?”.
Otherwise, where’s the choice? If I’m told that if I choose to take both boxes, I WILL not get the million, the whyyyy would I choose to do that?
And if it’s a perfect predictor of me, how does my answer even matter?
It’s like if my mum tells me: “If you tidy up your room, I’ll give you $100. If I find out you didn’t, you’re grounded”. This looks like a choice but, as everyone knows, is not (the mum here is also a perfect predictor of me).
Now, if there was clarity on how I can still exercise control over my circumstances, I guess it’d be clearer that it’s a genuine choice.
EDIT: I’m explaining my confusion, not claiming I’m right. Would be useful if others explained their disagreement so that I learn 🙏
This is useful. As someone not familiar with decision theory, Newcomb’s problem was super confusing to me when I was asked to answer it (or rather, the point it).
Stupidly enough, I kept asking whether I should assume Omega is aligned or misaligned XD, “does it want me to get the lesser amount of money so that I don’t donate it to AI Safety?”.
Otherwise, where’s the choice? If I’m told that if I choose to take both boxes, I WILL not get the million, the whyyyy would I choose to do that?
And if it’s a perfect predictor of me, how does my answer even matter?
It’s like if my mum tells me: “If you tidy up your room, I’ll give you $100. If I find out you didn’t, you’re grounded”. This looks like a choice but, as everyone knows, is not (the mum here is also a perfect predictor of me).
Now, if there was clarity on how I can still exercise control over my circumstances, I guess it’d be clearer that it’s a genuine choice.
EDIT: I’m explaining my confusion, not claiming I’m right. Would be useful if others explained their disagreement so that I learn 🙏
Thank you Katalina! Really glad to hear it was useful.