Tao Lin comments on WaPo: “Big Tech was moving cautiously on AI. Then came ChatGPT.”

[Tao Lin]

Facebooks models use maybe ¹⁄₄ the compute (rough guess) and have more implementation issues and worse finetuning