Why not A/B test TurnTrout’s proposal to get an empirically informed estimate of the effect size? That would put you in a better position to decide whether the tradeoffs are actually worth it.
A/B tests on social platforms are very annoying and difficult. I have spent hundreds of hours trying to get A/B tests to work, and have basically never learned anything useful from them. This also mirrors the experience of most people I know in product design.
Why not A/B test TurnTrout’s proposal to get an empirically informed estimate of the effect size? That would put you in a better position to decide whether the tradeoffs are actually worth it.
A/B tests on social platforms are very annoying and difficult. I have spent hundreds of hours trying to get A/B tests to work, and have basically never learned anything useful from them. This also mirrors the experience of most people I know in product design.
Huh! Is it because user behavior is so dependent on stuff like the content that it’s hard to control for the other factors?