Disclaimer : I would not pay and want to pay that much money anyway—so I am not your intended audience
I’d trust you more (and I would think members of the rationalist community would too) if you gave several metrics, even if some of them are not so good, with explanations. Right now, it seems you chose a metric so that it looks good.
More metrics would take more time but not much if you have the data easily available. This would be my suggestion :
You can provide three percentages ( like when one provides three quantiles instead of just the mean of data values) :
the percentage of success in people you discussed for at least an hour
the percentage among the people with reasonable chances of success (motivated + didn’t bail + your expertise + spent at least X hours)
the percentage among people with great chances of success.
These percentages, with precise information on what determines in which category clients fall in and the percentage of people treated who fall into each category, would give a first sound idea of the success rate.
Taking on low success rate people would not be a problem because their data is treated separately. It’s only a problem if 90% of your clients are unlikely to be helped but that would not be a good thing anyway.
hmm i suspect releasing these metrics could make my customers significantly more annoying. like, early adopters are fun and experimental. but if i make it seem not risky then i get risk-averse people who tend to be prickly
so maybe i will compile and release this data but i would need to figure out how to do it in a way that doesn’t change the funnel
Disclaimer : I would not pay and want to pay that much money anyway—so I am not your intended audience
I’d trust you more (and I would think members of the rationalist community would too) if you gave several metrics, even if some of them are not so good, with explanations. Right now, it seems you chose a metric so that it looks good.
More metrics would take more time but not much if you have the data easily available. This would be my suggestion :
You can provide three percentages ( like when one provides three quantiles instead of just the mean of data values) :
the percentage of success in people you discussed for at least an hour
the percentage among the people with reasonable chances of success (motivated + didn’t bail + your expertise + spent at least X hours)
the percentage among people with great chances of success.
These percentages, with precise information on what determines in which category clients fall in and the percentage of people treated who fall into each category, would give a first sound idea of the success rate.
Taking on low success rate people would not be a problem because their data is treated separately. It’s only a problem if 90% of your clients are unlikely to be helped but that would not be a good thing anyway.
i like this thanks. might take a bit of time to put together but interested
hmm i suspect releasing these metrics could make my customers significantly more annoying. like, early adopters are fun and experimental. but if i make it seem not risky then i get risk-averse people who tend to be prickly
so maybe i will compile and release this data but i would need to figure out how to do it in a way that doesn’t change the funnel