RSS

Glitch Tokens

TagLast edit: 18 Apr 2023 5:31 UTC by CronoDAS

Glitch Tokens are tokens in a language model that cause anomalous output, such as SolidGoldMagikarp.

SolidGoldMag­ikarp (plus, prompt gen­er­a­tion)

Jessica Rumbelow and mwatkins
5 Feb 2023 22:02 UTC
651 points
199 comments12 min readLW link

SolidGoldMag­ikarp II: tech­ni­cal de­tails and more re­cent findings

mwatkins and Jessica Rumbelow
6 Feb 2023 19:09 UTC
103 points
44 comments13 min readLW link

SolidGoldMag­ikarp III: Glitch to­ken archaeology

mwatkins and Jessica Rumbelow
14 Feb 2023 10:17 UTC
84 points
29 comments16 min readLW link

No­kens: A po­ten­tial method of in­ves­ti­gat­ing glitch tokens

Hoagy15 Mar 2023 16:23 UTC
16 points
0 comments4 min readLW link

The ‘ pe­ter­todd’ phenomenon

mwatkins15 Apr 2023 0:59 UTC
165 points
48 comments39 min readLW link

Smar­tyHead­erCode: anoma­lous to­kens for GPT3.5 and GPT-4

AdamYedidia15 Apr 2023 22:35 UTC
70 points
18 comments6 min readLW link

A Search for More ChatGPT /​ GPT-3.5 /​ GPT-4 “Un­speak­able” Glitch Tokens

Martin Fell9 May 2023 14:36 UTC
14 points
6 comments6 min readLW link
No comments.