One of the most important aspects of our epistemology with regards factual beliefs is that the set of beliefs a computationally unlimited agent should believe is uniquely determined by the evidence it has witnesses.
I don’t think this is true. Aumann’s agreement theorem shows that this is true in the limiting case assuming an infinite string of evidence. However, this isn’t the case for any finite amount of evidence. Indeed, simply choose different versions of the Solomonoff prior (different formulations of Turing machines change the Kolmogorov complexity by at most a constant but that still changes the Solomonoff priors. It just means that two different sets of priors need to look similar overall.)
Would a similar statement couched in terms of limits be true?
As an agent’s computational ability increases, its beliefs should converge with those of similar agents regardless of their priors.
The limit you proposed doesn’t help. One’s beliefs after applying Bayes’ rule are determined by the prior and by the evidence. We’re talking about a situation where the evidence is the the same and finite, and the priors differ. Having more compute power doesn’t enter into it.
I don’t think this is true. Aumann’s agreement theorem shows that this is true in the limiting case assuming an infinite string of evidence. However, this isn’t the case for any finite amount of evidence. Indeed, simply choose different versions of the Solomonoff prior (different formulations of Turing machines change the Kolmogorov complexity by at most a constant but that still changes the Solomonoff priors. It just means that two different sets of priors need to look similar overall.)
Would a similar statement couched in terms of limits be true?
As an agent’s computational ability increases, its beliefs should converge with those of similar agents regardless of their priors.
The limit you proposed doesn’t help. One’s beliefs after applying Bayes’ rule are determined by the prior and by the evidence. We’re talking about a situation where the evidence is the the same and finite, and the priors differ. Having more compute power doesn’t enter into it.