I’d love to see this experiment done with some novel tasks that wouldn’t be in the pre-training dataset at all. For instance, make up some fake new mathematical operations, maybe by making up arbitrary combinations of algebraic operations. For instance an & symbol being secretly assigned the meaning ‘add three before dividing by the following number ’. Or making a dataset of questions about a new fictional animal which combines traits of a variety of real animals in a novel way.
I’d love to see this experiment done with some novel tasks that wouldn’t be in the pre-training dataset at all. For instance, make up some fake new mathematical operations, maybe by making up arbitrary combinations of algebraic operations. For instance an & symbol being secretly assigned the meaning ‘add three before dividing by the following number ’. Or making a dataset of questions about a new fictional animal which combines traits of a variety of real animals in a novel way.