chanind comments on Matryoshka Sparse Autoencoders

[chanind]

It might also be an artifact of using MSE loss. Maybe a different loss term for reconstruction loss might not have this problem?