Fabien Roger comments on Censored LLMs as a Natural Testbed for Secret Knowledge Elicitation

[Fabien Roger]

I’d be curious to see the same results on LLMs’ relation to copyrighted songs. Some LLMs deny knowing famous song’s lyrics, or having these songs in their training data.