I thought about it some more and it seems you’re right. In learning problems we need some weighting of hypotheses to prevent overfitting, description length has no obvious downsides, so we can just use it and be happy. Now I just need to shoehorn Islam into the “learning problem” framework, to understand why our prior for it should be low...
I thought about it some more and it seems you’re right. In learning problems we need some weighting of hypotheses to prevent overfitting, description length has no obvious downsides, so we can just use it and be happy. Now I just need to shoehorn Islam into the “learning problem” framework, to understand why our prior for it should be low...
This isn’t about prior though.