Am I missing something or is GPT-4 able to do Length 20 Dynamic Programming using a solution it described itself very easily?https://chat.openai.com/share/8d0d38c0-e8de-49f3-8326-6ab06884df90
We have 100k context models and several OOMs more FLOPs to throw at models, I couldn’t see a reason why autoregressive models were limited in a substantial way given the evidence in the paper
Am I missing something or is GPT-4 able to do Length 20 Dynamic Programming using a solution it described itself very easily?
https://chat.openai.com/share/8d0d38c0-e8de-49f3-8326-6ab06884df90
We have 100k context models and several OOMs more FLOPs to throw at models, I couldn’t see a reason why autoregressive models were limited in a substantial way given the evidence in the paper