For gwern’s specific story, I agree it’s somewhat implausible that one engineer (tho with access to corporate compute) trains Clippy and there’s not lots of specialized models;
I think the broader argument of “can language models become gods” is a separate one.
My sole objective there was to point out flaws in this particular narrative (which hopefully I stated clearly in the beginning).
I think the “can language models become gods” debate is broader and I didn’t care much to engage with it, superficially it seems that some of the same wrong abstractions that lead to this kind of narrative also back up that premise, but I’m in no position to make a hands-down argument for that.
I think the broader argument of “can language models become gods” is a separate one.
My sole objective there was to point out flaws in this particular narrative (which hopefully I stated clearly in the beginning).
I think the “can language models become gods” debate is broader and I didn’t care much to engage with it, superficially it seems that some of the same wrong abstractions that lead to this kind of narrative also back up that premise, but I’m in no position to make a hands-down argument for that.
The rest of your points I will try to answer later, I don’t particularly disagree with any stated that way except on the margins (e.g. GLUE is a meaningless benchmark that everyone should stop using—a weak and readable take on this would be—https://www.techtarget.com/searchenterpriseai/feature/What-do-NLP-benchmarks-like-GLUE-and-SQuAD-mean-for-developers ), but I don’t think the disagreements are particularly relevant(?)