Language corruption. After training the language used in the registers becomes gibberish and uninterpretable. This will have to be solved by training losses which force the language to remain interpretable.
In the sense that you call some set of sentences interpretable, and only such sentences are allowed? Mightn’t it learn an arbitrary mapping between meanings and sentences?
In the sense that you call some set of sentences interpretable, and only such sentences are allowed? Mightn’t it learn an arbitrary mapping between meanings and sentences?