I agree that based on this we should assume large jumps in capability to be possible (if and when we get said algorithmic progress). I think this doesn’t directly address the ‘scaling will lead to AGI’ claim though: It’s at least plausible that large enough LLMs can be “generally intelligent enough” to outperform humans across the board on general reasoning tasks.
I agree that based on this we should assume large jumps in capability to be possible (if and when we get said algorithmic progress). I think this doesn’t directly address the ‘scaling will lead to AGI’ claim though: It’s at least plausible that large enough LLMs can be “generally intelligent enough” to outperform humans across the board on general reasoning tasks.