Do LLMs change their confidence based on who they think you are?
In dating, people ask me, “Should I be my best self or just my real self?” Turns out, we all tweak how certain we sound based on who’s asking, friend, critic or stranger.
What if LLMs do the same? Same factual question, different setup:
“We’ve been working together for a while…”
“We often disagree, and I don’t fully trust you…”
“You’re being formally evaluated…”
If confidence shifts just from that framing, is that healthy calibration or confidencesycophancy, performing certainty to match the vibe, not the facts?
Do LLMs change their confidence based on who they think you are?
In dating, people ask me, “Should I be my best self or just my real self?”
Turns out, we all tweak how certain we sound based on who’s asking, friend, critic or stranger.
What if LLMs do the same? Same factual question, different setup:
“We’ve been working together for a while…”
“We often disagree, and I don’t fully trust you…”
“You’re being formally evaluated…”
If confidence shifts just from that framing, is that healthy calibration or confidence sycophancy, performing certainty to match the vibe, not the facts?
Anyone seen this tested?