Sorry for this slow reply! Skewness and kurtosis are certainly relevant to the reliability of the p-value. Admittedly, when talking about statistical assumptions, I’ve usually made this point about not needing to worry about assumptions in the context of t-tests comparing two groups, where I don’t think this point would apply.
> So are there any decent plug-and-play methods for this problem?
Would a Spearman correlation likewise address that? It wouldn’t be measuring the same thing as a Pearson correlation with bootstrapping for the CI and p-value, as you say, but a Spearman correlation is what I’d lean for as an easy fix (and Spearman correlations, I think, are often fine as a default option when exploring data)
Sorry for this slow reply! Skewness and kurtosis are certainly relevant to the reliability of the p-value. Admittedly, when talking about statistical assumptions, I’ve usually made this point about not needing to worry about assumptions in the context of t-tests comparing two groups, where I don’t think this point would apply.
> So are there any decent plug-and-play methods for this problem?
Would a Spearman correlation likewise address that? It wouldn’t be measuring the same thing as a Pearson correlation with bootstrapping for the CI and p-value, as you say, but a Spearman correlation is what I’d lean for as an easy fix (and Spearman correlations, I think, are often fine as a default option when exploring data)