the 300x multiplier for compute will not be all lumped into increasing parameters / inference cost
Thanks, that’s an excellent and important point that I overlooked: the growth rate of inference cost is about half that of training cost.
Thanks, that’s an excellent and important point that I overlooked: the growth rate of inference cost is about half that of training cost.