Another factor is the higher inference cost for longer CoTs. OpenAI’s Monitoring Monitorability paper describes this as a “monitorability tax”.
But I don’t think it’s higher than increasing parameters to compensate for shorter COT?
Another factor is the higher inference cost for longer CoTs. OpenAI’s Monitoring Monitorability paper describes this as a “monitorability tax”.
But I don’t think it’s higher than increasing parameters to compensate for shorter COT?