Though I think that the condition that ‘nobody could memorize more than a fraction of it’ is actually quite hard to meet. E.g. legal training seems analogous, and lawyers seem to be able to remember a lot of examples.
If the corpus could be kept secret or ever changing that might help.
When I was thinking of something similar, I had a concern about the task length. E.g. will this result only in relatively short or simple tasks?
This is a good idea.
Though I think that the condition that ‘nobody could memorize more than a fraction of it’ is actually quite hard to meet. E.g. legal training seems analogous, and lawyers seem to be able to remember a lot of examples.
If the corpus could be kept secret or ever changing that might help.
When I was thinking of something similar, I had a concern about the task length. E.g. will this result only in relatively short or simple tasks?