So, in some sense, I’d think that there’s an “intelligence overhang”, where the raw intelligence that exists in these LLMs can’t fully unfold due to modality & context window limitations.
Another missing piece is research taste or curiosity. Of the sort you would need to come up with ideas for new papers.
Another missing piece is research taste or curiosity. Of the sort you would need to come up with ideas for new papers.