You could say the same about a trained immortal dog implementing an LLM. If so, the LLM’s state is what has understood the subject matter, not the dog.
At the very least, there can be thoughts too large to fit inside any human brain.
It’s an open question, and one I’m reluctant to fight about for Overton reasons, whether there’s any concept that John von Neumann’s brain can write into itself, such that nothing an IQ 90 brain can learn in any amount of time or experience will ever write that concept. (The case for ‘no’ being that maybe all human brains use the same knowledge representation and if so the IQ 90 brain will eventually write the same concept into storage.)
I rather expect there’s plenty of concepts that human brains don’t represent for reasons other than being too large—maybe, like, equivalents of spatial concepts in 20 dimensions, where sure you can deal with them using pen and paper but you’ll never see it in your head. But these of course are harder to exhibit to you.
But can every intellectual accomplishment finally be made by an average person with a 90 IQ and paper? Sure, in the limit. They just need to simulate training a large-enough LLM and turn the problem over to the LLM. Of course they might have to invent LLMs first, and the concept of Turing computability. Are we allowing them to start with that, or supposing that an immortal hunter-gatherer gets there eventually, or are we saying that IQ 90 people only become general intelligences after they’ve learned enough background knowledge that an immortal version of them will someday build up to calculus and gradient descent and transformers?
It was deliberate. It will not be modified. You can stop now.