Correct, in reality the world doesn’t change if we reorder our results. The point is that for a frequentist it feels like it should. Because the method is flawed, it seems right for the result to be less right. This is a bad way of analyzing results, but not as bad a way to evaluate methodologies.
Your valid concern about corrupted results stems from the correlation between bad behavior and what a frequentist calls a bad methodology.
Bessel’s methodology is not inherently bad either. If Bessel believed that the treatment would save lives and needed to keep going to prove it, wouldn’t he behave the same way?
We need a Bayesian methodology that can help evaluate methodology with and without informative priors. This probably already exists in literature, but we won’t be able to overcome the use of p-values until it is common knowledge.
Correct, in reality the world doesn’t change if we reorder our results. The point is that for a frequentist it feels like it should. Because the method is flawed, it seems right for the result to be less right. This is a bad way of analyzing results, but not as bad a way to evaluate methodologies.
Your valid concern about corrupted results stems from the correlation between bad behavior and what a frequentist calls a bad methodology.
Bessel’s methodology is not inherently bad either. If Bessel believed that the treatment would save lives and needed to keep going to prove it, wouldn’t he behave the same way?
We need a Bayesian methodology that can help evaluate methodology with and without informative priors. This probably already exists in literature, but we won’t be able to overcome the use of p-values until it is common knowledge.