I’m arguing we need more feedback rather than more filtering.
You’re arguing the new filtering will be more effective than the old filtering, and as proof, here is all the ways the old filtering method has failed.
But pointing out that filtering didn’t work in the past is not a criticism of my argument that we need more feedback such as through objective post-publication reviews of articles. I never argued that the old filtering method works.
If you believe the old filtering method isn’t a stringent filtering system, do you believe it wouldn’t make much difference if we removed it, and let anybody publish anywhere without peer review as long as they preregistered their study? Would this produce an improvement?
I think you also need to contend with the empirical evidence from COMPare that preregistration (the new filtering method you support) hasn’t been effective so far.
I think more stringent filtering can increase reliability, but doing so will also increase wastefulness. Feedback can increase reliability without increasing wastefulness.
Feedback from supervisors and feedback from reviewers is what the current system is mostly based on. We’re currently in a mostly-feedback system but it’s disorganised, poorly standardised feedback and the feedback tends to end a very short time after publication.
Some of the better journals operate blinded reviews so that in theory “anybody” should be able to publish a paper if the quality is good and that’s a good thing.
COMPare implies that preregistration didn’t solve all the problems but other studies have shown that it has massively improved matters.
I’m arguing we need more feedback rather than more filtering.
You’re arguing the new filtering will be more effective than the old filtering, and as proof, here is all the ways the old filtering method has failed.
But pointing out that filtering didn’t work in the past is not a criticism of my argument that we need more feedback such as through objective post-publication reviews of articles. I never argued that the old filtering method works.
If you believe the old filtering method isn’t a stringent filtering system, do you believe it wouldn’t make much difference if we removed it, and let anybody publish anywhere without peer review as long as they preregistered their study? Would this produce an improvement?
I think you also need to contend with the empirical evidence from COMPare that preregistration (the new filtering method you support) hasn’t been effective so far.
I think more stringent filtering can increase reliability, but doing so will also increase wastefulness. Feedback can increase reliability without increasing wastefulness.
Feedback from supervisors and feedback from reviewers is what the current system is mostly based on. We’re currently in a mostly-feedback system but it’s disorganised, poorly standardised feedback and the feedback tends to end a very short time after publication.
Some of the better journals operate blinded reviews so that in theory “anybody” should be able to publish a paper if the quality is good and that’s a good thing.
COMPare implies that preregistration didn’t solve all the problems but other studies have shown that it has massively improved matters.