Would be interesting to see how this translates to non-math tasks. I’m wondering if this is unique to the reasoning required for solving maths problems and if it still holds in tasks (like needle in a haystack for example) that may require reasoning over conflicting goals, etc.
I chose math because math is the main domain where there is a large CoT uplift. I am curious whether you know any good task where reasoning over conflicting goals is best done by using a CoT (the number of domains where CoT are useful is surprisingly small).
Not yet unfortunately. I have been toying with some multi-turn tasks lately in that space, but agreed that math/symbolic seems the clear winner for pushing CoT. (thanks for the paper link, will add to the queue!)
Would be interesting to see how this translates to non-math tasks. I’m wondering if this is unique to the reasoning required for solving maths problems and if it still holds in tasks (like needle in a haystack for example) that may require reasoning over conflicting goals, etc.
I chose math because math is the main domain where there is a large CoT uplift. I am curious whether you know any good task where reasoning over conflicting goals is best done by using a CoT (the number of domains where CoT are useful is surprisingly small).
Not yet unfortunately. I have been toying with some multi-turn tasks lately in that space, but agreed that math/symbolic seems the clear winner for pushing CoT. (thanks for the paper link, will add to the queue!)