I was making a narrow point about what I mean by “LLMs are (still) mostly powered by imitative learning, not RL”.
You seem to be saying: “Nobody ever would have expected that RLVR to build a whole giant new edifice of deep interconnected knowledge into an LLM, the way AlphaZero’s MCTS+RL training did. Duh, that’s obvious and overdetermined. So why are we even talking about that?”
But to the extent that that’s true, it would make my point stronger, not weaker. Because imitative learning can (and does) build a whole giant new edifice of deep interconnected knowledge into an LLM.
It seems like you’re trying to argue about takeoff speeds instead? If so, that seems off-topic here, I think. My take on that is at Foom & Doom 1: “Brain in a box in a basement”, including the part starting at “To be clear, the resulting ASI after those 0–2 years would not be an AI that already knows everything about everything…”
I was making a narrow point about what I mean by “LLMs are (still) mostly powered by imitative learning, not RL”.
You seem to be saying: “Nobody ever would have expected that RLVR to build a whole giant new edifice of deep interconnected knowledge into an LLM, the way AlphaZero’s MCTS+RL training did. Duh, that’s obvious and overdetermined. So why are we even talking about that?”
But to the extent that that’s true, it would make my point stronger, not weaker. Because imitative learning can (and does) build a whole giant new edifice of deep interconnected knowledge into an LLM.
It seems like you’re trying to argue about takeoff speeds instead? If so, that seems off-topic here, I think. My take on that is at Foom & Doom 1: “Brain in a box in a basement”, including the part starting at “To be clear, the resulting ASI after those 0–2 years would not be an AI that already knows everything about everything…”