I would expect the results to be better on, let’s say PaLM. I would also expect it to base more of its answers on content than form.
I think there are a ton of experiments in the direction of natural story plots that one could test and I would be interested in seeing them tested. The reason we started with relatively basic toy problems is that they are easier to control. For example, it is quite hard to differentiate whether the model learned based on form or content in a natural story context.
Overall, I expect there to be many further research projects and papers in this direction.
I would expect the results to be better on, let’s say PaLM. I would also expect it to base more of its answers on content than form.
I think there are a ton of experiments in the direction of natural story plots that one could test and I would be interested in seeing them tested. The reason we started with relatively basic toy problems is that they are easier to control. For example, it is quite hard to differentiate whether the model learned based on form or content in a natural story context.
Overall, I expect there to be many further research projects and papers in this direction.