The thing is, if we follow the line of argument that the number of pieces of information must correspond to the number of possible hypotheses, then surely you would need an infinite number of pieces of information because the number of possible hypotheses (possible statements about the universe) is infinite too.
See Bayesian probability, Occam’s razor, Kolmogorov complexity, Solomonoff induction. You only need to raise a certain hypothesis in probability above the alternatives, not exclude all other hypotheses with certainty.
See Bayesian probability, Occam’s razor, Kolmogorov complexity, Solomonoff induction. You only need to raise a certain hypothesis in probability above the alternatives, not exclude all other hypotheses with certainty.