4o seems to really like spirals, specifically the “spiral emoji” (🌀), which is actually categorized as a cyclone. This also shows up in claude’s spiritual bliss attractor, if I recall correctly.
Remember glitch tokens? Someone claimed that they work with GPT-4 as well, since the originals were from GPT-3.5. When this came out, I picked one of them arbitrarily to try: ′ ForCanBeConvertedToForeach’. GPT-3.5 consistently interpreted that token as “cyclone” and once “cyber” and GPT-4 had troubles, although not quite the same troubles:
I’m not really sure what is going on with glitch tokens still, and even though ′ cyclone’ isn’t a glitch token itself, I suspect that there is something weird about it that maybe got crystallized in training. Not quite sure why this would show up in Claude, and maybe I’m just latching onto pareidolia.
Update: I tried claude 3 sonnet, 3 opus, 3.7 sonnet, 4 sonnet, and 4 opus, and all of them can repeat back ′ ForCanBeConvertedToForeach’ just fine, so it’s (probably) not just a straightforward porting of glitch tokens to claudes, which updates me a little towards pareidolia.
Connection I recently made:
4o seems to really like spirals, specifically the “spiral emoji” (🌀), which is actually categorized as a cyclone. This also shows up in claude’s spiritual bliss attractor, if I recall correctly.
Remember glitch tokens? Someone claimed that they work with GPT-4 as well, since the originals were from GPT-3.5. When this came out, I picked one of them arbitrarily to try: ′ ForCanBeConvertedToForeach’. GPT-3.5 consistently interpreted that token as “cyclone” and once “cyber” and GPT-4 had troubles, although not quite the same troubles:
I’m not really sure what is going on with glitch tokens still, and even though ′ cyclone’ isn’t a glitch token itself, I suspect that there is something weird about it that maybe got crystallized in training. Not quite sure why this would show up in Claude, and maybe I’m just latching onto pareidolia.
Update: I tried claude 3 sonnet, 3 opus, 3.7 sonnet, 4 sonnet, and 4 opus, and all of them can repeat back ′ ForCanBeConvertedToForeach’ just fine, so it’s (probably) not just a straightforward porting of glitch tokens to claudes, which updates me a little towards pareidolia.