Hmm; your second point is pretty compelling to me (“when I take human-written text and ask AI to translate it, it does not get flagged as AI-generated”). I’m curious how robust that is.
Literally 100% for me asking Claude to take text and translate it (including old Papal encyclicals), but that’s small n and maybe it is copying the style of publicly-available human-written translations. That said Pangram gives you a couple of free checks a day and I’d encourage people to play around with this!
I’ve just tried this once, getting Claude to write a paragraph in Latin, translating it to English myself, and plugging it into Pangram. Surprisingly to me, Pangram flags it as 100% AI-generated, even though it doesn’t sound all that AI-ish to my ear (but admittedly I don’t have the most acute ear for such things). Also note that the translation was kind of a rush, and I could probably have made it sound more pleasing (e.g. “a big rock” could probably have been “a large rock”, and “I’m in the habit of walking” is not obviously the best way of rendering “ambulare soleo”).
Literally 100% for me asking Claude to take text and translate it (including old Papal encyclicals), but that’s small n and maybe it is copying the style of publicly-available human-written translations. That said Pangram gives you a couple of free checks a day and I’d encourage people to play around with this!
(Ideally other people would check with LLMs other than Claude)
The converse question is more of a bother, but: any data on how human translations of AI-generated text show up on Pangram?
I’ve just tried this once, getting Claude to write a paragraph in Latin, translating it to English myself, and plugging it into Pangram. Surprisingly to me, Pangram flags it as 100% AI-generated, even though it doesn’t sound all that AI-ish to my ear (but admittedly I don’t have the most acute ear for such things). Also note that the translation was kind of a rush, and I could probably have made it sound more pleasing (e.g. “a big rock” could probably have been “a large rock”, and “I’m in the habit of walking” is not obviously the best way of rendering “ambulare soleo”).
None that I have.