While I haven’t done a rigorous study of the effect, my gut feeling is that the vast majority of suggestive and interesting phenomena eventually fall apart due to these exact reasons.
This is why I do not give much thought to this sort of stuff.
Ideally, I’d do a rigorous study of initially-interesting-but-later-fell-apart-studies or find someone else who has and then maybe I’d be better able to spend my cognitive resources...
While I haven’t done a rigorous study of the effect, my gut feeling is that the vast majority of suggestive and interesting phenomena eventually fall apart due to these exact reasons.
This is why I do not give much thought to this sort of stuff.
Ideally, I’d do a rigorous study of initially-interesting-but-later-fell-apart-studies or find someone else who has and then maybe I’d be better able to spend my cognitive resources...