Igor Ostrovsky

• Igor Ostrovsky 13 Dec 2021 20:59 UTC

  4 points

  in reply to: mtaran’s comment on: Teaser: Hard-cod­ing Trans­former Models

  I (not the OP) put it up here for now: https://​​igor0.github.io/​​hand/​​distill/​​

  I’ll take it down if MadHatter asks me or once there is an official site.

• Igor Ostrovsky 13 Dec 2021 20:54 UTC

  2 points

  on: Teaser: Hard-cod­ing Trans­former Models

  Building up toy transformer models by hand that work … that’s super interesting, both for interpretability and also education.

  I put up the site [here](https://​​igor0.github.io/​​hand/​​distill/​​) for now. MadHatter, let me know if you want me to take it down.