I always enjoy convoluted Omega situations, but I don’t understand how these theoretical entities get to the point where their priors are as stated (and especially the meta-priors about how they should frame the decision problem).
Before the start of the game, Omega has some prior distribution of the Agent’s beliefs and update mechanisms. And the Agent has some distribution of beliefs about Omega’s predictive power over situations where the Agent “feels like” it has a choice. What experiences cause Omega to update sufficiently to even offer the problem (ok, this is easy: quantum brain scan or other Star-Trek technobabble)? But what lets the Agent update to believing that their qualia of free-will is such an illusion in this case? And how do they then NOT meta-update to understand the belief-action-payout matrix well enough to take the most-profitable action?
Moved to my shortform—it’s not a direct answer to the post.
I would prefer if you wrote up your own post objecting to the general frame in which I’m operating in. I don’t feel that this is the right location to have this discussion.
I always enjoy convoluted Omega situations, but I don’t understand how these theoretical entities get to the point where their priors are as stated (and especially the meta-priors about how they should frame the decision problem).
Before the start of the game, Omega has some prior distribution of the Agent’s beliefs and update mechanisms. And the Agent has some distribution of beliefs about Omega’s predictive power over situations where the Agent “feels like” it has a choice. What experiences cause Omega to update sufficiently to even offer the problem (ok, this is easy: quantum brain scan or other Star-Trek technobabble)? But what lets the Agent update to believing that their qualia of free-will is such an illusion in this case? And how do they then NOT meta-update to understand the belief-action-payout matrix well enough to take the most-profitable action?
Moved to my shortform—it’s not a direct answer to the post.
Thanks. I’ve added a link to your shortform post
I would prefer if you wrote up your own post objecting to the general frame in which I’m operating in. I don’t feel that this is the right location to have this discussion.