I would like to see it be given a list of the natural numbers (in order) as a prompt and then asked to do basic arithmetic. I wonder if the scores would improve over what’s been reported. In particular, would be interesting to see if ‘1 2 3 4 … N, what is 14 + 15?’ type prompts improve on the zero shot performance?
I would like to see it be given a list of the natural numbers (in order) as a prompt and then asked to do basic arithmetic. I wonder if the scores would improve over what’s been reported. In particular, would be interesting to see if ‘1 2 3 4 … N, what is 14 + 15?’ type prompts improve on the zero shot performance?