The thing I actually expect is “LLMs with lots of RL training of diverse gamelike environments and problem sets, and some algorithmic tweaks”. Do you not expect that to work, or just by the time it does work, it will have evolved sufficiently beyond the current LLM paradigm, the resulting model will be better thought of as a new kind of thing?
I would include “constructivist learning” in your list, but I agree that LLMs seem capable of this. By “constructivist learning” I mean a scientific process where the learning conceives of an experiment on the world, tests the idea by acting on the world, and then learns from the result. A VLA model with incremental learning seems close to this. RL could be used for the model update, but I think for ASI we need learnings from real-world experiments.
The thing I actually expect is “LLMs with lots of RL training of diverse gamelike environments and problem sets, and some algorithmic tweaks”. Do you not expect that to work, or just by the time it does work, it will have evolved sufficiently beyond the current LLM paradigm, the resulting model will be better thought of as a new kind of thing?
I would include “constructivist learning” in your list, but I agree that LLMs seem capable of this. By “constructivist learning” I mean a scientific process where the learning conceives of an experiment on the world, tests the idea by acting on the world, and then learns from the result. A VLA model with incremental learning seems close to this. RL could be used for the model update, but I think for ASI we need learnings from real-world experiments.