Noosphere89 comments on Towards Monosemanticity: Decomposing Language Models With Dictionary Learning

[Noosphere89]

A useful advance, but it definitely needs to scale, and you could reasonably argue that it still needs a lot more work before it can be very useful.