Yes, I have to test the hypothesis with bigger models and multiple question sets, I will be posting the results and will surely tag you.Note: I believe that reasoning is something which is needed even for small tasks(in human context), Even a statement,”A=2, B=3, A+B=?”“A+B=?, A=2, B=3”In the 2nd statement, a human will stumble a bit or will think, where is A and B?, to answer the question, which was not same with the LLM.
Yes, I have to test the hypothesis with bigger models and multiple question sets, I will be posting the results and will surely tag you.
Note: I believe that reasoning is something which is needed even for small tasks(in human context), Even a statement,
”A=2, B=3, A+B=?”
“A+B=?, A=2, B=3”
In the 2nd statement, a human will stumble a bit or will think, where is A and B?, to answer the question, which was not same with the LLM.