Building the infrastructure for training a model of several trillion parameters could easily create a chip shortage, drastically increasing costs of AI chips, and thus leading to training costing way more than the estimate.
Doing this slowly might be the sort of increased demand that would increase investment, and decrease price.
Doing this slowly might be the sort of increased demand that would increase investment, and decrease price.