Finally in order to come to a conclusion via Bayesian updating, you first need a prior. The problem is that there’s no practical objective way to come up with a prior (Solomonoff induction is not practical). This means that you can come to any conclusion you like based on the available evidence by choosing a suitable prior.
One way to deal with that would be to require scientists to specify their priors when registering their study setup. It doesn’t increase the complexity of registering the study very much but it does give you a prior. It also allows you to look at all the studies by a given scientist to find out how well calibrated their priors are.
One way to deal with that would be to require scientists to specify their priors when registering their study setup. It doesn’t increase the complexity of registering the study very much but it does give you a prior. It also allows you to look at all the studies by a given scientist to find out how well calibrated their priors are.