I assumed that the GPT’s were just generating the next word based on the previous words, one word at a time. Now I am confused.
GPT-3 does indeed only depend on the past few thousand words. AI Dungeon, however, can depend on a whole lot more.
I assumed that the GPT’s were just generating the next word based on the previous words, one word at a time. Now I am confused.
GPT-3 does indeed only depend on the past few thousand words. AI Dungeon, however, can depend on a whole lot more.