FYI, two days after I published this, Beren Millidge published How can LLM RL Work Despite Information-Theoretic Inefficiency. I don’t think it contradicts anything I wrote here; rather it complements it by asking and answering different questions. Recommended!
FYI, two days after I published this, Beren Millidge published How can LLM RL Work Despite Information-Theoretic Inefficiency. I don’t think it contradicts anything I wrote here; rather it complements it by asking and answering different questions. Recommended!