StefanHex comments on How to use and interpret activation patching

[StefanHex]

Imagine a circuit

A --> B --> C
D --> E --> F
C + F --> output

Denoising (restoring) B + E is sufficient to restore behaviour, but B + E are just a “cross-section” (cutting through the circuit at the 2nd layer), not a superset of all components