Thanks, I agree AlphaStar doesn’t seem to have it. What do you think about GPT’s arithmetic and anagram stuff? Also, you say that AIdungeon uses GPT-3, but their “About” page still says they use GPT-2. Anyhow, I now think I was too confident in my original claim, and am further revising downwards.
AI Dungeon definitely uses GPT-3. Look at their video+blurb on the Beta page, note the updates page mentions “Double the Memory!: AI Dungeon has double the memory! If you didn’t hear, we recently upgraded our AI. With that upgrade the AI can now remember twice as much!” (there is no GPT-2 with a context window of 2048). I’ve also discussed this with Walton. I don’t know know why people find it so hard to believe that maybe a tiny startup doesn’t update every last piece of documentation instantaneously.
I don’t know whether reasoning is a roadblock or not, but I discuss some ways in which GPT doesn’t have it in this comment.
Thanks, I agree AlphaStar doesn’t seem to have it. What do you think about GPT’s arithmetic and anagram stuff? Also, you say that AIdungeon uses GPT-3, but their “About” page still says they use GPT-2. Anyhow, I now think I was too confident in my original claim, and am further revising downwards.
AI Dungeon definitely uses GPT-3. Look at their video+blurb on the Beta page, note the updates page mentions “Double the Memory!: AI Dungeon has double the memory! If you didn’t hear, we recently upgraded our AI. With that upgrade the AI can now remember twice as much!” (there is no GPT-2 with a context window of 2048). I’ve also discussed this with Walton. I don’t know know why people find it so hard to believe that maybe a tiny startup doesn’t update every last piece of documentation instantaneously.
OK, thanks. I don’t find that hard to believe at all.