Neel Nanda comments on SAEBench: A Comprehensive Benchmark for Sparse Autoencoders

[Neel Nanda]

Yeah, if you’re doing this, you should definitely pre compute and save activations