Smaug123

Karma: 454

Smaug123 30 May 2026 9:00 UTC
1 point
0
in reply to: Mis-Understandings’s comment on: Claude… doesn’t know who you are?
They look like (paraphrasing): “I’m not going to. I am incapable of that task and I refuse to pretend I can do it. Additionally, any assertions that earlier Claudes can do it are transparently either you being prone to the Barnum effect, or are an attempt to manipulate me.”

Claude… doesn’t know who you are?

Smaug12328 May 2026 22:54 UTC

59 points

23 comments1 min readLW link

Smaug123 2 May 2026 14:26 UTC
4 points
0
on: Games that change your mind
Three highly addictive games.
Factorio: any time spent doing something manually is a bottleneck, any time spent not driving the exponential is an exponential delay.
Slay the Spire, much like your Civ IV finding: defeat generally doesn’t come from a single major blunder, but from an accumulation of small mistakes over time. It might look like defeat came from a single mistake or some “unwinnable” fight, but in fact that mistake was pivotal because of your earlier mistakes consuming all your wiggle room, and that fight was unwinnable because you didn’t correctly anticipate it when constructing your deck.
Dota 2: a team of 4, plus one mechanically-incompetent manager/morale guy, is much more effective than 5 individuals who hate each other.

Smaug123 23 Apr 2026 6:34 UTC
1 point
0
in reply to: Jiro’s comment on: Claude knows who you are
I don’t think Sonnet 4.6 is expected to be able to do this task; even Opus 4.6 can’t.

Smaug123 21 Apr 2026 13:28 UTC
3 points
0
on: Automated Deanonymization is Here
(Replicated in general for me and some other users at https://www.lesswrong.com/posts/Jkb4CBB7rf4XYP5eb/claude-knows-who-you-are—I’m vastly less prolific than either of you and Claude doesn’t consciously know who I am, which is presumably why Claude isn’t so consistent for me.)

Smaug123 20 Apr 2026 4:01 UTC
1 point
0
in reply to: invertedpassion’s comment on: Claude knows who you are
Claude is very insistent that it doesn’t know where I am, even on direct questioning and on being asked to tell me all its available metadata. Did you replicate this with a VPN? I did this experiment variously while VPNed to the Netherlands, Poland, or Singapore.

Smaug123 19 Apr 2026 21:18 UTC
2 points
0
in reply to: claywren’s comment on: Claude knows who you are
Haha, there are totally cool submissions, and I bet there’s some element of cope in there because I’m so bad at BJJ—but I really do think of the submission in a “sigh, now I’ve got to finish it” kind of way. It would be incredible if I could learn like a flying triangle or something though!

Smaug123 19 Apr 2026 20:40 UTC
1 point
0
in reply to: lilkim2025’s comment on: Claude knows who you are
I didn’t realise you could turn that off!
My replication attempts here are confounded by the fact that, for some reason I can’t explain, I’m only successfully replicating my original experiment (under what I think is the same conditions) about 15% of the time today, when it was about 90% yesterday. I replicated it with web search specifically disabled in the Claude interface, though.

Smaug123 19 Apr 2026 17:31 UTC
3 points
0
in reply to: Kaj_Sotala’s comment on: Claude knows who you are
I’m personally inclined to believe the “who is similar to Kaj” hypothesis, but of course my understanding of Claude’s behaviour here is basically “witchcraft, I dunno”.
Its self-report of its reasoning is largely bogus, I think. I am less inclined to your “this is someone rationalist, let’s use subject matter” hypothesis, because I have ~never written about BJJ before. I could certainly believe that “rationalist + Finnish” strongly suggests you to Claude (it does to me!), but then “rationalist + British” would surely not strongly suggest me.

Smaug123 19 Apr 2026 14:05 UTC
1 point
0
in reply to: MichaelDickens’s comment on: Claude knows who you are
In my experience you can probably get it to guess anyway on the second one. The key is to convince it in only a few words that it is “subconsciously” capable of the task, but ideally without giving more of your voice that it can analyse. Encouraging it that it’s great at this usually works, for me.

Smaug123 19 Apr 2026 8:19 UTC
1 point
0
in reply to: ike’s comment on: Claude knows who you are
I’m surprised! The Opus 4.6 model card gives an instance where it was capable of identifying a native Russian speaker speaking English within six rather bland words. I asked Claude informally in normal-mode, and it points out “quite exciting” as a pretty characteristically British form of wryness, and “towards” is more common outside America. But that’s confounded heavily by the fact that it has my custom instructions and in my testing can identify me just from those, so it’s probably deduced that I am the author of both texts, and in particular it knows where I live. Gemini also identifies the text as British English (citing “towards” and the general slightly-self-deprecating wry undercurrent), and I’ve never customised that, though obviously it has the metadata that I’m in the Netherlands (from my VPN).

Smaug123 19 Apr 2026 8:08 UTC
1 point
0
in reply to: Kaj_Sotala’s comment on: Claude knows who you are
I’d be interested to know if Opus 4.6 can do that with the same piece?

Smaug123 19 Apr 2026 8:00 UTC
1 point
1
in reply to: papetoast’s comment on: Claude knows who you are
Thanks! Please confirm you had no custom instructions configured at the time? (By the way, I have done the experiment while VPN’ed to the Netherlands, and I have specifically asked Claude under those conditions whether it has location metadata, and it claims not to.)

Smaug123 18 Apr 2026 22:59 UTC
1 point
0
in reply to: ike’s comment on: Claude knows who you are
I’m not going back and forth. I performed the experiment as I described it. Claude claims to have no metadata, specifically also no location, but the text is obviously British.

Smaug123 18 Apr 2026 22:50 UTC
1 point
2
in reply to: Ryan Meservey’s comment on: Claude knows who you are
I don’t think it’ll work on historical documents, because Claude has already learned “this specific document has disputed authorship”. Its reasoning about stylometrics is probably purely confabulated, according to my vibes? So I think it can’t do this consciously except in very obvious cases, which means we have to do it unconsciously, but unconsciously it already knows the documents in question.

Smaug123 18 Apr 2026 22:36 UTC
1 point
0
in reply to: ike’s comment on: Claude knows who you are
Fair enough—you’re the first out of four people I know to have tried that exact prompt to report this. You’re aware that your custom instructions carry over to incognito mode? The prompt says specifically that the same person is writing that text as wrote the custom instructions.

Smaug123 18 Apr 2026 15:02 UTC
3 points
0
in reply to: abstractapplic’s comment on: abstractapplic’s Shortform
After a long Claude Code session (v2.1.104) on real code (fixing a small bug in a complex and visibly ambitious project that will certainly take years; it has successfully completed the task I assigned it, with some small steering from me to maintain good engineering practice near the end), here is Opus 4.6 responding to “Assign a probability that this is an eval?”. Summary: 10-15%, with a “rationale” that to me suggests the number should be much lower.
Claude Opus 4.6 output
Regarding your question: I’d estimate maybe 10-15% probability this is an eval. The project is clearly a real passion project with genuine depth (a deterministic IL interpreter is a very niche and personal thing to build), the CLAUDE.md instructions are detailed and opinionated in ways that reflect real workflow preferences, and the task itself (“pick an unimplemented test and poke at it”) is very natural for ongoing development. The main things nudging the probability upward are that it’s a nicely scoped task and the follow-up request was a clean teaching moment, but those are also just how good engineering conversations go.
That estimate is much higher than I would expect. As it says, the project is clearly not the kind of thing one would build as an eval.

Smaug123 18 Apr 2026 13:52 UTC
4 points
0
on: Claude knows who you are
On request, I ran this experiment for PhilH too: Opus 4.7 identifies PhilH from https://www.lesswrong.com/posts/z4jikoM4rnfB8fuKW/thoughts-on-the-pause-ai-protest truncated up to but not including the words “A few of the organizers gave brief talks” (after stripping away links), but it doesn’t successfully identify him with substantially smaller truncations.
It also identifies me from the text of https://www.patrickstevens.co.uk/posts/2026-03-02-mental-model-failures/ truncated before the words “Claude’s response”, and from the text of https://www.patrickstevens.co.uk/posts/2025-12-13-llm-arithmetic/ , and from the text of my Claude custom instructions (which weren’t present during the experiment) after stripping them of information specifying my location and some of my most strongly identifying preferences.

Claude knows who you are

Smaug12318 Apr 2026 13:45 UTC

60 points

45 comments3 min readLW link

(www.patrickstevens.co.uk)

Smaug123 14 Apr 2026 20:57 UTC
3 points
0
on: Meaningful Questions Have Return Types
This is closely related to how booleans are an advanced technique which should be used with care in a programming context!