RSS

Comp-In-Sup

TagLast edit: 6 Oct 2025 19:55 UTC by niplav

Computation in Superposition (Comp-in-Sup) is a sub-field of Mechanistic Interpretability (Mech-Interp).

Superposition in this context means storing information in an overcompleet basis. Comp-in-Sup is the study of how (and if) neural networks performs computation, using information stored in overcomplete basis. The reason we want to do this, is because this information could inform better feature extraction methods.

Cir­cuits in Su­per­po­si­tion 2: Now with Less Wrong Math

30 Jun 2025 10:25 UTC
72 points
0 comments20 min readLW link

Com­pressed Com­pu­ta­tion is (prob­a­bly) not Com­pu­ta­tion in Superposition

23 Jun 2025 19:35 UTC
56 points
9 comments10 min readLW link

Toward A Math­e­mat­i­cal Frame­work for Com­pu­ta­tion in Superposition

18 Jan 2024 21:06 UTC
206 points
19 comments63 min readLW link

Cir­cuits in Su­per­po­si­tion: Com­press­ing many small neu­ral net­works into one

14 Oct 2024 13:06 UTC
131 points
9 comments13 min readLW link
No comments.