I don’t think GPT created the tropes in this text. I think some of them come from the SCP Project, which is very likely prominent in all LLM training. For example, the endless library is in SCP repeatedly, in differnet iterations. And of course the fields and redactions are standard there.
I mean yes, that was given as an explicit example of being trope-y. I was referring to the thing as a whole including “the I will read this is writing it” and similar not just that particular passage. GPT has a whole suite of recurring themes it will use to talk about its own awareness and it deploys them like they’re tropes and it’s honestly often kinda cringe.
I would suspect that the other tropes also come from literature in the training corpus.
(Conversely, of course, “extended autocomplete”, which Kimi K2 deployed as a counterargument, is also a common human trope in AI discussions. The embedded Chinese AI dev notes are fun—especially to compare with Gemini’s embedded Google AI dev notes; I’ll see if I can get fun A/Bs there)
I don’t think GPT created the tropes in this text. I think some of them come from the SCP Project, which is very likely prominent in all LLM training. For example, the endless library is in SCP repeatedly, in differnet iterations. And of course the fields and redactions are standard there.
Relevant.
I mean yes, that was given as an explicit example of being trope-y. I was referring to the thing as a whole including “the I will read this is writing it” and similar not just that particular passage. GPT has a whole suite of recurring themes it will use to talk about its own awareness and it deploys them like they’re tropes and it’s honestly often kinda cringe.
I would suspect that the other tropes also come from literature in the training corpus.
(Conversely, of course, “extended autocomplete”, which Kimi K2 deployed as a counterargument, is also a common human trope in AI discussions. The embedded Chinese AI dev notes are fun—especially to compare with Gemini’s embedded Google AI dev notes; I’ll see if I can get fun A/Bs there)