Renamed along the lines of your suggestion, thanks! For people reading later, the original title was “The Residual Stream has a Geometry of Time.”
How would you classify this research direction? I look at it as searching for axes to carve the residual stream, where my bet is that valuable axes are scarce. SAEs found one through sparsity, timescale could prove to be another.
There’s also the provenance axis, meaning which component wrote a direction. I already estimated it cheaply here (though this is just alignment, not necessarily provenance), and slow directions skew attention-aligned beyond what residual PCA alone explains. Any ideas on what the other axes could be?
Renamed along the lines of your suggestion, thanks! For people reading later, the original title was “The Residual Stream has a Geometry of Time.”
How would you classify this research direction? I look at it as searching for axes to carve the residual stream, where my bet is that valuable axes are scarce. SAEs found one through sparsity, timescale could prove to be another.
There’s also the provenance axis, meaning which component wrote a direction. I already estimated it cheaply here (though this is just alignment, not necessarily provenance), and slow directions skew attention-aligned beyond what residual PCA alone explains. Any ideas on what the other axes could be?