Raemon comments on Polluting the agentic commons

Raemon 13 Apr 2023 17:41 UTC
2 points
0
The current trend is for these models to become smaller and smaller to the point where they will soon run locally on a smartphone.
I agree they will become smaller, but I would guess this is not the current trend. Why do you think that?
- the gears to ascension 13 Apr 2023 18:15 UTC
  2 points
  0
  Parent
  I agree with OP but will not explain further.
- hamandcheese 13 Apr 2023 18:31 UTC
  1 point
  0
  Parent
  Can read about quantization and the compression of GPT models here:
  https://beuke.org/quantization/