Jiaxing Wu

• Jiaxing Wu 4 Mar 2026 12:24 UTC

  1 point

  0

  in reply to: Joseph Bloom’s comment on: [Paper] A is for Ab­sorp­tion: Study­ing Fea­ture Split­ting and Ab­sorp­tion in Sparse Autoencoders

  That makes sense, thanks!

• Jiaxing Wu 15 Dec 2025 13:54 UTC

  1 point

  0

  on: [Paper] A is for Ab­sorp­tion: Study­ing Fea­ture Split­ting and Ab­sorp­tion in Sparse Autoencoders

  Hi, thanks for this post and this inspired me something.

  But I still can’t get why you think feature absorption is “pathological”. It’s actually plausible to me that if SAEs don’t have enough latents to learn every ground truth feature then they tend to distinguish some of the child features while mix the other lower priority ones in a parent feature. Why do you take this as undesirable?

  Or did you mean that this will make the interpretation of a specific feature noisier because we describe a parent feature as “starts with ‘e’” while it actually means “starts with ‘e’ and not ‘elephant’”? If so, I guess this is actually a result of our imperfect auto-interp method?

• Jiaxing Wu 22 Nov 2024 8:20 UTC

  1 point

  0

  on: Fix­ing Fea­ture Sup­pres­sion in SAEs

  Hi, thanks for your work. I was wondering why we use scaling to modify the activation here rather than using an analytical solution by compensating for the −cd/​2 term.