Realmbird

• Realmbird 18 Apr 2026 18:11 UTC

  1 point

  0

  on: Can we in­ter­pret la­tent rea­son­ing us­ing cur­rent mechanis­tic in­ter­pretabil­ity tools?

  With how CoDI throws away the hidden state and only uses the kv values on the <|eocot|> token the accuracy drop after latent 5 could just be kv values can’t store more info.

• Realmbird 18 Aug 2025 21:10 UTC

  1 point

  0

  in reply to: Paul Bogdan’s comment on: Thought An­chors: Which LLM Rea­son­ing Steps Mat­ter?

  How did you learn that vertical attention corresponded to sentences?