Ilverin the Stupid and Offensive comments on Google’s new 540 billion parameter language model

Ilverin the Stupid and Offensive 9 Apr 2022 3:36 UTC
2 points
Maybe https://en.wikipedia.org/wiki/Minifloat is a way to cheat flop metric?
- Nathan Helm-Burger 9 Apr 2022 18:49 UTC
  3 points
  Parent
  That’s already what TPUs do, basically
- Pattern 9 Apr 2022 18:53 UTC
  2 points
  Parent
  I think that higher precision isn’t always needed (or used efficiently).