Realmbird comments on Natural Language Autoencoders Produce Unsupervised Explanations of LLM Activations

[Realmbird]

For Qwen2.5-7B-Instruct’s NLAs I found evidence that NLA answer appearing in AV increases as the token approaches the model’s final answer.