Agree. I expect them to be more fully used in the future. As inference scaling improves, it means there will be more tasks that can be done with 100% of token limits but not 10% of token limits. Companies will probably adjust pricing strategy in response.
Agree. I expect them to be more fully used in the future. As inference scaling improves, it means there will be more tasks that can be done with 100% of token limits but not 10% of token limits. Companies will probably adjust pricing strategy in response.