I think it’s pretty clear you’re talking about different things here.
I thought so too, which is why I asked him what he thought a delta function in the distribution space meant.
One of them, (1/3, 1⁄3, 1⁄3), represents fairness, and is just one among many possibilities.
Right; but putting a delta function there means you’re infinitely certain that’s what it is, because you give probability 0 to all other possibilities.
It could equally well represent being certain that it’s biased to land on only one side every time, but you have no idea which side.
Knowing that the die is completely biased, but not which side it is biased towards, would be represented by three delta functions, at (1,0,0), (0,1,0), and (0,0,1), each with a coefficient of (1/3). This is very different from the uniform case and the delta at (1/3,1/3,1/3) case, as you can see by calculating the posterior distribution for observing that the die rolled a 1.
okay, and you were just trying to make sure that Manfred knows that all this probability-of-distributions speech you’re speaking isn’t, as he seems to think, about the degree-of-belief-in-my-current-state-of-ignorance distribution for the first roll. Gotcha.
Okay… but do we agree that the degree-of-belief distribution for the first roll is (1/3, 1⁄3, 1⁄3), whether it’s a fair die or a completely biased in an unknown way die?
Because I’m pretty sure that’s what Manfred’s talking about when he says
There is a single correct distribution for our starting information, which is (1/3,1/3,1/3),
and I think him going on to say
the “distribution across possible distributions” is just a delta function there.
was a mistake, because you were talking about different things.
EDIT:
I thought so too, which is why I asked him what he thought a delta function in the distribution space meant.
Ah. Yes. Okay. I am literally saying only things that you know, aren’t I. My bad.
I thought so too, which is why I asked him what he thought a delta function in the distribution space meant.
Right; but putting a delta function there means you’re infinitely certain that’s what it is, because you give probability 0 to all other possibilities.
Knowing that the die is completely biased, but not which side it is biased towards, would be represented by three delta functions, at (1,0,0), (0,1,0), and (0,0,1), each with a coefficient of (1/3). This is very different from the uniform case and the delta at (1/3,1/3,1/3) case, as you can see by calculating the posterior distribution for observing that the die rolled a 1.
okay, and you were just trying to make sure that Manfred knows that all this probability-of-distributions speech you’re speaking isn’t, as he seems to think, about the degree-of-belief-in-my-current-state-of-ignorance distribution for the first roll. Gotcha.
Okay… but do we agree that the degree-of-belief distribution for the first roll is (1/3, 1⁄3, 1⁄3), whether it’s a fair die or a completely biased in an unknown way die?
Because I’m pretty sure that’s what Manfred’s talking about when he says
and I think him going on to say
was a mistake, because you were talking about different things.
EDIT:
Ah. Yes. Okay. I am literally saying only things that you know, aren’t I. My bad.