From https://epochai.org/blog/optimally-allocating-compute-between-inference-and-training, seems consistent with this post’s main assumption: ‘If it is feasible to trade off inference and training compute, we find that it is optimal for AI labs to spend similar amounts on training and inference.’
From https://epochai.org/blog/optimally-allocating-compute-between-inference-and-training, seems consistent with this post’s main assumption: ‘If it is feasible to trade off inference and training compute, we find that it is optimal for AI labs to spend similar amounts on training and inference.’