> Re: “Extrapolating GPT-N performance” and “Revisiting ‘Is AI Progress Impossible To Predict?’” sections of google doc
Read Section 6 titled “The Limit of the Predictability of Scaling Behavior” of “Broken Neural Scaling Laws” paper: https://arxiv.org/abs/2210.14891
> Re: “Extrapolating GPT-N performance” and “Revisiting ‘Is AI Progress Impossible To Predict?’” sections of google doc
Read Section 6 titled “The Limit of the Predictability of Scaling Behavior” of “Broken Neural Scaling Laws” paper:
https://arxiv.org/abs/2210.14891