Humans are much better learners than these supervised learning systems—they learn from fewer examples, and have a better grasp of the meaning and structure behind examples. This hints that there are some big improvements to be made in value learning.
Josh Tenenbaum’s work is relevant in figuring out how to achieve this. E.g. this.
I already skimmed this paper after looking through your review article looking for interesting papers, but it was worth a re-read, thanks. I’ll follow up some references later. I like how it just completely unironically brings up the Chinese restaurant process and the Indian buffet process. I think the examples are fairly easy, in the sense of low numbers of features and quite simple desired models, and I’d be interested to know what the limitations are that lead to this fact.
Josh Tenenbaum’s work is relevant in figuring out how to achieve this. E.g. this.
I already skimmed this paper after looking through your review article looking for interesting papers, but it was worth a re-read, thanks. I’ll follow up some references later. I like how it just completely unironically brings up the Chinese restaurant process and the Indian buffet process. I think the examples are fairly easy, in the sense of low numbers of features and quite simple desired models, and I’d be interested to know what the limitations are that lead to this fact.