Why doesn’t Anthropic publish meaningful data on RSI? Given that they are in the best position to accurately forecast RSI and a positive result is highly beneficial to them as a business (especially with their eye on an IPO), one has to wonder why they haven’t published any rigorous studies.
This leads to the conclusion that:
They simply did not try to collect this data (seems unlikely given how important a positive result could be)
Their studies so far have shown negative or inconclusive results. Or atleast not anything stronger than public data (METR task horizons, etc)
Why doesn’t Anthropic publish meaningful data on RSI? Given that they are in the best position to accurately forecast RSI and a positive result is highly beneficial to them as a business (especially with their eye on an IPO), one has to wonder why they haven’t published any rigorous studies.
This leads to the conclusion that:
They simply did not try to collect this data (seems unlikely given how important a positive result could be)
Their studies so far have shown negative or inconclusive results. Or atleast not anything stronger than public data (METR task horizons, etc)