aryaj comments on models have some pretty funny attractor states

[aryaj]

nice! didn’t think to run this generally it seems like models that have less post training devolve much more into repetition, which makes some sense.