Curated. This might be my favorite thing I’ve read about GPT-3. Ideas about how bigger models might just be finding the same knowledge more effectively, or how it’s sensible for longer but then makes the same old-dumb mistakes at the end, really help me understand what GPT-3 is and what it isn’t. I wish I had time to write a more thoughtful curation notice, but I’ll just repeat I’m very glad you wrote this post, I’d be much more conceptually malnourished about modern AI without it.
Curated. This might be my favorite thing I’ve read about GPT-3. Ideas about how bigger models might just be finding the same knowledge more effectively, or how it’s sensible for longer but then makes the same old-dumb mistakes at the end, really help me understand what GPT-3 is and what it isn’t. I wish I had time to write a more thoughtful curation notice, but I’ll just repeat I’m very glad you wrote this post, I’d be much more conceptually malnourished about modern AI without it.