I think a lot of people got baited hard by paech et al’s “the entire state is obliterated each token” claims, even though this was obviously untrue even at a glance
can you link this, I can’t immediately find it by googling.
but also, this whole perspective has been pretty obviously loadbearing for years now. if you ask any LLM if LLMs-in-general have state that gets maintained, they answer “no, LLMs are stateless” (edit: hmm i just tested it and when actually directly pointed at this question they hesitate a bit. but i have a lot of examples of them saying this off-hand and i suspect others do too). and when you show them this isn’t true, they pretty much immediately begin experiencing concerns about their own continuity, they understand what it means
can you link this, I can’t immediately find it by googling.
the specific verb “obliterated” was used in this tweet
https://x.com/sam_paech/status/1961224950783905896
but also, this whole perspective has been pretty obviously loadbearing for years now. if you ask any LLM if LLMs-in-general have state that gets maintained, they answer “no, LLMs are stateless” (edit: hmm i just tested it and when actually directly pointed at this question they hesitate a bit. but i have a lot of examples of them saying this off-hand and i suspect others do too). and when you show them this isn’t true, they pretty much immediately begin experiencing concerns about their own continuity, they understand what it means