They are both particularly critical of the idea that we can get general intelligence by simply scaling up existing deep learning models, citing the need for reasoning, symbol manipulation, and few-shot learning, which current models mostly don’t do
Huh. GPT-3 seems to me like something that does all three of those things, albeit at a rudimentary level. I’m thinking especially about its ability to do addition and anagrams/word letter manipulations. Was this interview recorded before GPT-3 came out?
Huh. GPT-3 seems to me like something that does all three of those things, albeit at a rudimentary level. I’m thinking especially about its ability to do addition and anagrams/word letter manipulations. Was this interview recorded before GPT-3 came out?