Super interesting! I wonder how easy it would be to port an NLA from one model to another at scale. Also, did you have any thoughts about using another type of SAE (ReLU, TopK)?
Super interesting! I wonder how easy it would be to port an NLA from one model to another at scale. Also, did you have any thoughts about using another type of SAE (ReLU, TopK)?