Sodium comments on LLMs as Giant Lookup-Tables of Shallow Circuits

[Sodium]

I flushed out a similar idea in (Maybe) A Bag of Heuristics is All There Is & A Bag of Heuristics is All You Need

[niplav]

Yup, that post looks very similar, maybe minus the computation-in-superposition part?