On the right path but not as rad as I thought it would be. I heard GPT-4 only has around 80 billion parameters so a much bigger scale up is necessary to really blow our minds like I had hoped if it had 10 trillion parameters. Anyone else have any thoughts?
On the right path but not as rad as I thought it would be. I heard GPT-4 only has around 80 billion parameters so a much bigger scale up is necessary to really blow our minds like I had hoped if it had 10 trillion parameters. Anyone else have any thoughts?
where did you hear 80 billion params?