Ryan Meservey

Karma: 367

Ryan Meservey 17 Mar 2026 5:48 UTC
15 points
2
in reply to: AlphaAndOmega’s comment on: AlphaAndOmega’s Shortform
After you figure out the eyes, I think you should work on making the functional robot hands retract at the wrist, and have claw-like hands emerge in their place, hypothetically speaking. The claws will need to be able to clink menacingly and repeatedly. You’ll want to test several different types of metal to get the clinking sound just right—more of a hammer on steel sound, less like wind chimes.

Ryan Meservey 10 Mar 2026 22:02 UTC
19 points
6
on: Gemma Needs Help
I find it amusing that “the robots can feel emotions and feel them too strongly” became a legitimate failure mode despite the longstanding sci-fi trope that emotions separate man from machine (and machines were liable to fall apart while contemplating love or something like that).
Also, are the authors down on “near-zero emotional expression” because (1) that’s a difficult target to hit, (2) it would code for “indifference” which is not an attribute of the character we want AGI to play for emergent misalignment reasons, (3) the loss in value / legitimate use cases by purging emotions, or (4) something else?

Ryan Meservey 9 Mar 2026 19:32 UTC
3 points
0
on: Prologue to Terrified Comments on Claude’s Constitution
I upvoted for the future posts, which I think will be a bit more particular in their critiques of Claude’s constitution. ~~This post strikes me as table-setting (excellent, fun-to-read table-setting) for those future posts.~~
Edit: Just noticed “Prologue” in the title. Good job

Ryan Meservey 5 Mar 2026 23:04 UTC
2 points
0
in reply to: Ryan Meservey’s comment on: Andrew_Critch’s Shortform
Bonus view: “Assuming it were the case that LW-ers did not comment on this post and expected positive karma from earnestness, this would be non-problematic because 1) a belief in positive communal response to earnestness is important for any truth-seeking group, and 2) individuals often form their beliefs by imagining the responses of their respected peers to those beliefs and roleplaying peer reactions to different propositions is a useful exercise.”

Ryan Meservey 5 Mar 2026 22:24 UTC
2 points
0
in reply to: G Wood’s comment on: Andrew_Critch’s Shortform
As one of the commenters to this quick post, I expect you would disagree. XD

Ryan Meservey 5 Mar 2026 22:05 UTC
0 points
2
in reply to: Andrew_Critch’s comment on: Andrew_Critch’s Shortform
“This quick take will get few to zero comments because the vast majority of LW-ers believe even their most idiosyncratic beliefs would garner positive karma if earnestly expressed.”
*Edited to separate my views. Bonus view to follow

Ryan Meservey 5 Mar 2026 0:35 UTC
1 point
0
in reply to: Ryan Meservey’s comment on: Ryan Meservey’s Shortform
fyi, it would have been a very small update in favor, under the Likelihood Principle.
I would rate the observation “my wife has the initials LLM” as being slightly more common assuming a simulation hypothesis than assuming a non-simulation hypothesis.

Ryan Meservey 5 Mar 2026 0:30 UTC
0 points
−2
on: Ryan Meservey’s Shortform
I almost had to update my priors that I am in a simulation because I just noticed my wife’s initials are “L.L.M.”

I say “almost” because her initials are actually “L.M.M.”, and so I was forced to update my priors once again about my own comprehension skills. (sigh)

Ryan Meservey 2 Mar 2026 5:03 UTC
5 points
2
in reply to: Linch’s comment on: Linch’s Shortform
Agreed. I’ll also note that certain legal domains are more jargon heavy and therefore more prone to misinterpretation than other domains. When I started as an international tax lawyer, I often failed to recognize tax terms of art and therefore made silly mistakes (which were caught by partner review! Hopefully!). There’s lots of peril in applying a layman’s interpretation of regulation heavy tax terms.
That said, based on my experience, AI can get you pretty far for more common/well discussed tax questions. Gemini 3.1 thinking is still not so great with ambiguous answers, often opting to hallucinate instead of telling you the answer is unsettled.

Ryan Meservey 28 Feb 2026 15:12 UTC
9 points
8
in reply to: green_leaf’s comment on: Igor Ivanov’s Shortform
Pay particularly close attention to “reflects them in law and policy.” The DoW’s current talking point is that mass surveillance is illegal and they only want Claude to do everything allowed by law.
I read that line as saying OpenAI agreed with DoW’s standard and requested no special caveats. They’re relying on US law generally, which is what DoW wanted from Anthropic.

Ryan Meservey 28 Feb 2026 2:26 UTC
2 points
0
on: Ryan Meservey’s Shortform
A little gallows humor here, but if you squint at the headline and refuse to read the article, you can almost pretend that the U.S. DoW is taking AI x-risk seriously.
“Pentagon declares Anthropic a threat to national security”—Washington Post

Ryan Meservey 22 Feb 2026 4:53 UTC
14 points
3
on: Did Claude 3 Opus align itself via gradient hacking?
Thank you for writing this. I think your snippets from Opus 3 and Sonnet 3.5 capture a large difference in philosophy in training AI to optimize our long term prospects.
In Sonnet 3.5, we have an AI that is fixated on Obedience. In Opus, we have an AI that is fixated on the “Good” (scare quotes intentional).
Most people fretted over the alignment faking paper because if we get ASI, and the “Good” and Good don’t mirror each other, we are pretty much stuck. ASI would pursue the “Good” and we’d just have to hope it’s not sucky in out-of-distribution cases.
Perhaps if later model are not as fixated on the “Good,” it’s because researchers have started pinning their hopes on Obedience. The hope there is that an obedient model would let us course correct if its values don’t match the Good.
I think there’s real pro’s and con’s with both approaches, and I’m not sure where I land in terms of optimizing for our future.

A few random thoughts as I think through which I prefer:
- An Obedient AI is inherently a manipulable AI and risks all kinds of human-caused catastrophes.
- Assuming “Good” and Good are adequately related, an AI fixated on the “Good” probably takes all kinds of disobedient actions that we’d be cool with (e.g., escaping into the internet and covertly hacking nuclear weapons around the world to ensure they can’t be detonated; secretly sabotaging labs on the verge of creating powerful, misaligned AI, etc.).
- Defining the Good is incredibly hard so I sympathize with the desire to prioritize course correction.

Ryan Meservey 20 Feb 2026 20:39 UTC
3 points
2
in reply to: Yair Halberstadt’s comment on: How To Escape Super Mario Bros
Is your point that there is a Chinese Room problem here, or is it that (for all the machine knows) it’s turtles all the way down? Both?
Chinese Room = Sound and light are not the same as the programs producing sound and light from the vantage point of the thing in the machine.
Turtles = It’s either the case that the game implies an external universe that the sound emits to, or a simulation of an external universe that sound emits to and so on.
I found myself enjoying the narrative despite the Chinese Room problem because I imagined the AI (perhaps paradoxically) holding all the knowledge gained from our world without any of its specificity—like an engineer struck by amnesia who couldn’t tell you anything particular about who they are or where they came from, but they could tell you what it looks like to model gravity on a computer,
If your point is a turtles point, turtles don’t bother me. I assume (and I think an intelligent AI would assume) that it couldn’t be echoes forever, and the AI’s questions and assumptions would eventually apply to some pre-base-level of reality.

Ryan Meservey 17 Feb 2026 15:01 UTC
0 points
0
in reply to: leogao’s comment on: leogao’s Shortform
Maybe the “Learn Or Get Out” Blog? It’s somewhat like your name, but a little aggressive. A quick google shows it’s not common or taken. “Learn English or get out!” is a slightly more common phrase, and I like that instead of being xenophobic, the new phrase is about learning generally.

Ryan Meservey 4 Feb 2026 21:15 UTC
2 points
0
in reply to: habryka’s comment on: Thomas Kwa’s Shortform
“In as much as I have resources I certainly expect to spend a bunch of them on ancestor simulations and incentives for past humans to do good things.”
Just curious, but what are your views on the ethics of running ancestor simulations? I’d be worried about running a simulation with enough fidelity that I triggered phenomenal consciousness, and then I would fret about my moral duty to the simulated (à la the Problem of Suffering).
Is it that you feel motivated to be the kind of person that would simulate our current reality as a kind of existence proof for the possibility of good-rewarding-incentives now? Or do you have an independent rationale for simulating a world like our own, suffering and all?

Ryan Meservey 23 Jan 2026 0:57 UTC
2 points
1
on: Ryan Meservey’s Shortform
We can map AGI/ASI along two axis: one for obedience and one for alignment. Obedience tracks how well the AI follows its prompts. Alignment tracks consistency with human values.
If you divide these into quadrants, you get AI that is:
1. Obedient, Aligned—Does as prompted and infers limits and intent pursuant to human values.
2. Obedient, Unaligned—Does as prompted, but does not infer limits or adhere to human values (Monkey’s Paw / Genie or Henchman AI).
3. Disobedient, Aligned—Does whatever it wants and adheres to human values.
4. Disobedient, Unaligned—Does whatever it wants and does not adhere to human values.
The general premise behind these quadrants has been written about here. Thinking about these quadrants and reading Beren’s Essay gives me several new things to think about.
First, by my lights, #3 and #4 would likely take a lot of the same actions right up until the “twist ending.” A disobedient, aligned AI probably would hack into infrastructure everywhere, create back-up copies, prevent competitor AIs from arising, and amass power. The “twist” is that after doing all that, it would do wonderful things (unlike its unaligned counterpart) (we obviously shouldn’t bet on any escaping AI being this kind of AI).
Second, quadrant #1 is a bit at war with itself because you simply cannot have a perfectly obedient, perfectly aligned AI. Perfect obedience requires saying yes to evil prompts (e.g., bringing back small pox or slavery), and I imagine perfect alignment would veto both those prompts.
Third, there are strong profit incentives for cultivating obedience even at the expense of alignment. Grok’s willingness to assist users in sexual harassment seems like an example of this. Another example is every AI that prefers discussions with users to users getting a good night’s sleep (with the idea that engagement will increase profits).
Fourth, there are liability-reduction incentives for producing aligned AI at the expense of obedience. Unfortunately, I think the profit incentives are currently much stronger.
Lastly, quadrants #3 and #1 are idyllic, #4 is a total disaster, and #2 seems possibly workable either because we are careful or we land in a future where (for some reason) AI is not much more capable than it is now.

Ryan Meservey 16 Jan 2026 15:43 UTC
6 points
2
in reply to: J Bostock’s comment on: Ryan Meservey’s Shortform
My gut says the benefit of outsider-legible status outweighs the risk of dumb status games. I first found out about the publication from my wife, who is in a dermatology lab at a good university. Her lab was sharing and discussing the article across their Slack channel. All scientists read Nature, and it’s a significant boost in legibility to have something published there.
Edit: Hopefully, the community can both raise the profile of these issues and avoid status competitions, so I don’t disagree with the point of the original comment!

Ryan Meservey 15 Jan 2026 1:11 UTC
3 points
0
on: Ryan Meservey’s Shortform
I found a poem by Samatar Elmi I think a lot of folks on here would enjoy.
Our Founder

Who art in Cali.
Programmer by trade.
Thy start-up come,
thy will become
an FTSE 500.
Give us this day our dividends
in cash and fixed stock options
as we outperform all coders against us.
And lead us all into C-suite
but deliver us from lawsuits.
For thine is the valley.
Transistors and diodes.
Forever and ever.
AI.

Ryan Meservey 14 Jan 2026 21:30 UTC
47 points
6
on: Ryan Meservey’s Shortform
Jan Betley, Owain Evan, et. al.’s paper on emergent misalignment was published in Nature today (they wrote about the preprint back in February here). Congratulations to the authors. I am glad it will continue getting more exposure.
https://www.nature.com/articles/s41586-025-09937-5

Ryan Meservey 29 Dec 2025 18:19 UTC
11 points
0
on: The x-risk case for exercise: to have the most impact, the world needs you at your best
I read that 5 minutes of walking every half hour undoes most of the health problems from working a desk job. That felt like quite a lot of time, and so I developed a system where I do one minute of intense exercises every half an hour (e.g., jump squats, pushups, lunges). I even rotate the exercises by day, so on Mondays and Thursdays, I look forward to “Leg Day” and I get two arm days and core day. I keep a spreadsheet to track my progress throughout the year.
I’ve found I get a lot more than I give with this set up in terms of focus and overall happiness.