Bart Bussmann

• Bart Bussmann 15 Dec 2025 22:20 UTC

  6 points

  0

  in reply to: Bart Bussmann’s comment on: Bart Buss­mann’s Shortform

  Update! I missed an entire evolutionary branch of the meme: “You can just do stuff” (rather than “things”).
  
  In March 2021, @leaacta tweets:

  life hack: you don’t have to explain yourself or understand anything, you can just do stuff

  And gets retweeted by a bunch of people in TPOT.
  

  Then, in June 2022, comedian Rodney Norman posts a video called Go Be Weird with a motivational speech of some sort:

  Hey, you know you can just do stuff?

  Like, you don’t need anybody’s permission or anything.

  You just… you just kind of come up with weird stuff you want to go do, and you just go do it.

  Okay? Go be weird.

  Okay, bye.

  In August 2022, @nat_sharpe_ posts a video where he does a bunch of cool and weird things, with Rodney Norman’s speech as background sound. With this and after this he seems to play a major role in popularizing “you can just do stuff” on Twitter.
  
  
  Sam Altman is also involved in this version of the meme, and in September 2022 he posts:

  you can just...do stuff it isn’t more complicated

• Bart Bussmann 14 Dec 2025 13:27 UTC

  16 points

  0

  on: Bart Buss­mann’s Shortform

  On the origins of “you can just do things”

  About once every 15 minutes, someone tweets “you can just do things”. It seems like a rather powerful and empowering meme and I was curious where it came from, so I did some research into its origins. Although I’m not very satisfied with what I was able to reconstruct, here are some of the things that I found:
  
  
  In 1995, Steve Jobs gives the following quote in an interview:

  Life can be much broader, once you discover one simple fact, and that is that everything around you that you call life was made up by people that were no smarter than you. And you can change it, you can influence it, you can build your own things that other people can use. Once you learn that, you’ll never be the same again.

  Although he says nothing close to the phrase “you can just do things”, I think it’d be a fair summary of his message.
  

  
  Fast forward to October 2020, where Twitter user nosilverv tweets:

  PSA: if you feel bad you can just DO THINGS until you feel better

  Although this is the first tweet I’ve found^[1] that contains the exact phrasing, it doesn’t seem to quite match the current sentiment. It seems to imply that you can do random things and shouldn’t let bad feelings stop you, rather than the “high agency” framing it has today.
  

  
  A year later, in October 2021, @Neel Nanda publishes the blog post What’s Stopping You?. I think this post points exactly in the “you can just do things” direction, and contains the following quote:

  Part of this mindset is taking responsibility—realising that you can do things and influence the world, and that by taking it upon yourself to fix or improve something the world will be better than if you did nothing.

  So close, just missing the “just”!
  

  
  Then in February 2022, substacker crypticdefinitions posts a post titled You can just do things:

  Advice probably obvious to everyone but myself
  You can just go and try new things. It costs almost nothing and has extremely high potential upside. You can go try a new hobby or skill. You can pay for a singing lesson or squash coaching session or cooking course. You can email someone who seems somewhat interesting about a subject of mutual interest.

  
  From here on, in the first half of 2022, some people on Twitter seem to start to adopt this phrase, such as @AskYatharth and @m_ashcroft. The phrase seems to slowly but steadily gain popularity in TPOT in the years 2023-2024. In January 2024, Cate Hall writes a blog post on “How to be more agentic” and announces the working title of her book “You can just do things”.
  

  
  In December 2024 Sam Altman tweets “you can just do things” with 25K likes and the meme seems to break all containment.

  1. ^

     Unfortunately, the Twitter search function is completely broken and useless, so there may be earlier tweets I’ve not been able to find.

Cur­rent LLMs seem to rarely de­tect CoT tampering

• Bart Bussmann 16 Jul 2025 9:17 UTC

  3 points

  0

  on: Bart Buss­mann’s Shortform

  When working with SAE features, I’ve usually relied on a linear intuition: a feature firing with twice the strength has about twice the “impact” on the model. But while playing with an SAE trained on the final layer I was reminded that the actual direct impact on the relative token probabilities grows exponentially with activation strength. While a feature’s additive contribution to the logits is indeed linear with its activation strength, the ratio of probabilities of two competing tokens $P\left(A\right)/P\left(B\right)$ is equal to the exponent of the logit difference $\exp \left(\text{logit}\right(A)-\text{logit}(B\left)\right)$.

  If we have a feature that boosts logit(A) and not logit(B) and we multiply its activation strength by a factor of 5.0, this doesn’t 5x its effect on $P\left(A\right)/P\left(B\right)$, but rather raises its effect to the 5th power. If this feature caused token A to be three times as likely as token B before, it now makes this token 3^5 = 243 times as likely! This might partly explain why the lower activations for a feature are often less interpretable than the top activations. Their direct impact on the relative token probabilities is exponentially smaller.

  Note that this only holds for the direct ‘logit lens’-like effect of a feature. This makes this intuition mostly applicable to features in the final layers of a model, as the impact of earlier features is probably mostly modulated by their effect on later layers.

• Bart Bussmann 5 Apr 2025 7:06 UTC

  1 point

  0

  in reply to: mozzarellapesto’s comment on: Learn­ing Multi-Level Fea­tures with Ma­tryoshka SAEs

  Interesting idea, I had not considered this approach before!
  
  I’m not sure this would solve feature absorption though. Thinking about the “Starts with E-” and “Elephant” example: if the “Elephant” latent absorbs the “Starts with E-” latent, the “Starts with E-” feature will develop a hole and not activate anymore on the input “elephant”. After the latent is absorbed, “Starts with E-” wouldn’t be in the list to calculate cumulative losses for that input anymore.
  
  Matryoshka works because it forces the early-indexed latents to reconstruct well using only themselves, whether or not later latents activate. I think this pressure is key to stopping the later-indexed latents from stealing the job of the early-indexed ones.

• Bart Bussmann 23 Dec 2024 8:34 UTC

  1 point

  1

  in reply to: Jose Sepulveda’s comment on: Learn­ing Multi-Level Fea­tures with Ma­tryoshka SAEs

  Although the code has the option to add a L1-penalty, in practice I set the l1_coeff to 0 in all my experiments (see main.py for all hyperparameters).

• Bart Bussmann 23 Dec 2024 8:32 UTC

  4 points

  0

  on: Hire (or be­come) a Think­ing As­sis­tant /​ Body Double

  I haven’t actually tried this, but recently heard about focusbuddy.ai, which might be a useful ai assistant in this space.

Learn­ing Multi-Level Fea­tures with Ma­tryoshka SAEs

• Bart Bussmann 14 Dec 2024 14:27 UTC

  LW: 35 AF: 20

  2

  AF

  on: Ma­tryoshka Sparse Autoencoders

  Great work! I have been working on something very similar and will publish my results here some time next week, but can already give a sneak-peak:

  The SAEs here were only trained for 100M tokens (1/​3 the TinyStories^[11:1] dataset). The language model was trained for 3 epochs on the 300M token TinyStories dataset. It would be good to validate these results with more ‘real’ language models and train SAEs with much more data.

  I can confirm that on Gemma-2-2B Matryoshka SAEs dramatically improve the absorption score on the first-letter task from Chanin et al. as implemented in SAEBench!

  Is there a nice way to extend the Matryoshka method to top-k SAEs?

  Yes! My experiments with Matryoshka SAEs are using BatchTopK.
  
  Are you planning to continue this line of research? If so, I would be interested to collaborate (or otherwise at least coordinate on not doing duplicate work).
  

• Bart Bussmann 28 Nov 2024 15:32 UTC

  2 points

  0

  on: Visi­ble Thoughts Pro­ject and Bounty Announcement

  Three years later, and we actually got LLMs with visible thoughts, such as Deepseek, QwQ, and (although partially hidden from the user) o1-preview.

  I (Nate) find it plausible that there are capabilities advances to be had from training language models on thought-annotated dungeon runs.

  
  Good call!

• Bart Bussmann 23 Nov 2024 19:56 UTC

  8 points

  3

  in reply to: Daniel Kokotajlo’s comment on: Daniel Koko­ta­jlo’s Shortform

  Sing along! https://​​suno.com/​​song/​​35d62e76-eac7-4733-864d-d62104f4bfd0

• Bart Bussmann 7 Nov 2024 15:31 UTC

  5 points

  0

  in reply to: Daniel Kokotajlo’s comment on: Could we use cur­rent AI meth­ods to un­der­stand dolphins?

  This project seems to be trying to translate whale language.

• Bart Bussmann 2 Oct 2024 9:33 UTC

  6 points

  0

  in reply to: Canaletto’s comment on: weightt an’s Shortform

  You might enjoy this classic: https://​​www.lesswrong.com/​​posts/​​9HSwh2mE3tX6xvZ2W/​​the-pyramid-and-the-garden

• Bart Bussmann 25 Sep 2024 19:51 UTC

  6 points

  0

  in reply to: Joseph Bloom’s comment on: [Paper] A is for Ab­sorp­tion: Study­ing Fea­ture Split­ting and Ab­sorp­tion in Sparse Autoencoders

  Rather than doubling down on a single single-layered decomposition for all activations, why not go with a multi-layered decomposition (ie: some combination of SAE and metaSAE, preferably as unsupervised as possible). Or alternatively, maybe the decomposition that is most useful in each case changes and what we really need is lots of different (somewhat) interpretable decompositions and an ability to quickly work out which is useful in context.
  

  
  Definitely seems like multiple ways to interpret this work, as also described in SAE feature geometry is outside the superposition hypothesis. Either we need to find other methods and theory that somehow finds more atomic features, or we need to get a more complete picture of what the SAEs are learning at different levels of abstraction and composition.
  
  Both seem important and interesting lines of work to me!
  
  

• Bart Bussmann 25 Sep 2024 13:06 UTC

  8 points

  0

  on: [Paper] A is for Ab­sorp­tion: Study­ing Fea­ture Split­ting and Ab­sorp­tion in Sparse Autoencoders

  Great work! Using spelling is very clear example of how information gets absorbed in the SAE latent, and indeed in Meta-SAEs we found many spelling/​sound related meta-latents.
  
  I have been thinking a bit on how to solve this problem and one experiment that I would like to try is to train an SAE and a meta-SAE concurrently, but in an adversarial manner (kind of like a GAN), such that the SAE is incentivized to learn latent directions that are not easily decomposable by the meta-SAE.
  
  Potentially, this would remove the “Starts-with-L”-component from the “lion”-token direction and activate the “Starts-with-L” latent instead. Although this would come at the cost of worse sparsity/​reconstruction.

• Bart Bussmann 18 Sep 2024 7:41 UTC

  1 point

  0

  in reply to: tailcalled’s comment on: Why I’m bear­ish on mechanis­tic in­ter­pretabil­ity: the shards are not in the network

  I think @RogerDearnaley means Sparse Autoencoders (SAEs), see for example these papers and the SAE tag on LessWrong.

Show­ing SAE La­tents Are Not Atomic Us­ing Meta-SAEs

Cal­en­dar fea­ture ge­om­e­try in GPT-2 layer 8 resi­d­ual stream SAEs

• Bart Bussmann 1 Aug 2024 3:24 UTC

  7 points

  2

  in reply to: habryka’s comment on: tlevin’s Shortform

  Having been at two LH parties, one with music and one without, I definitely ended up in the “large conversation with 2 people talking and 5 people listening”-situation much more in the party without music.
  
  That said, I did find it much easier to meet new people at the party without music, as this also makes it much easier to join conversations that sound interesting when you walk past (being able to actually overhear them).
  
  This might be one of the reasons why people tend to progressively increase the volume of the music during parties. First give people a chance to meet interesting people and easily join conversations. Then increase the volume to facilitate smaller conversations.

• Bart Bussmann 23 Jul 2024 17:23 UTC

  5 points

  0

  on: Car­ing about excellence

  I just finished reading “Zen and the Art of Motorcycle Maintenance” yesterday, which you might enjoy reading as it explores the topic of Quality (what you call excellence). From the book:

  “Care and Quality are internal and external aspects of the same thing. A person who sees Quality and feels it as he works is a person who cares. A person who cares about what he sees and does is a person who’s bound to have some characteristic of quality.”