Bart Bussmann comments on Prompt injection in Google Translate reveals base model behaviors behind task-specific fine-tuning

[Bart Bussmann]

It’s funny how this is like a reverse Searle’s Chinese room. A system meant to just shuffle some tokens around can’t help but understand its meaning!