Peter Boos

• Peter Boos 22 Dec 2023 7:20 UTC

  1 point

  0

  on: Dis­cus­sion: Challenges with Un­su­per­vised LLM Knowl­edge Discovery

  I think you might apply this to the hot neurons, the neurons who are most used.
  Some recent models allready handle those diffrent for speedup reason.