Glitch Tokens

TagLast edit: 15 Mar 2023 17:52 UTC by Raemon

Glitch Tokens are tokens in a language model that cause anomalous output, such as SolidGoldMagickCarp(sp?)

Nokens: A potential method of investigating glitch tokens

Hoagy15 Mar 2023 16:23 UTC

16 points

0 comments4 min readLW link

SolidGoldMagikarp II: technical details and more recent findings

mwatkins and Jessica Rumbelow

6 Feb 2023 19:09 UTC

101 points

44 comments13 min readLW link

SolidGoldMagikarp (plus, prompt generation)

Jessica Rumbelow and mwatkins

5 Feb 2023 22:02 UTC

646 points

194 comments12 min readLW link

SolidGoldMagikarp III: Glitch token archaeology

mwatkins and Jessica Rumbelow

14 Feb 2023 10:17 UTC

77 points

24 comments16 min readLW link

No comments.