Thomas Kwa

Karma: 7,121

Member of technical staff at METR.

Previously: MIRI → interp with Adrià and Jason → METR.

I have signed no contracts or agreements whose existence I cannot mention.

Claude, GPT, and Gemini All Struggle to Evade Monitors

Vincent Cheng and Thomas Kwa

Aug 6, 2025, 8:28 PM

61 points

22 votes

Overall karma indicates overall quality.

3 comments5 min readLW link

METR: How Does Time Horizon Vary Across Domains?

Thomas Kwa and Vincent Cheng

Jul 14, 2025, 4:13 PM

84 points

30 votes

Overall karma indicates overall quality.

8 comments14 min readLW link

(metr.org)

Tsinghua paper: Does RL Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?

Thomas KwaMay 5, 2025, 6:56 PM

69 points

36 votes

Overall karma indicates overall quality.

21 comments2 min readLW link

(arxiv.org)

Should CA, TX, OK, and LA merge into a giant swing state, just for elections?

Thomas KwaNov 6, 2024, 11:01 PM

115 points

60 votes

Overall karma indicates overall quality.

35 comments1 min readLW link

The murderous shortcut: a toy model of instrumental convergence

Thomas KwaOct 2, 2024, 6:48 AM

37 points

17 votes

Overall karma indicates overall quality.

0 comments2 min readLW link

Goodhart in RL with KL: Appendix

Thomas KwaMay 18, 2024, 12:40 AM

12 points

5 votes

Overall karma indicates overall quality.

0 comments6 min readLW link

Catastrophic Goodhart in RL with KL penalty

Thomas Kwa and Adrià Garriga-alonso

May 15, 2024, 12:58 AM

62 points

19 votes

Overall karma indicates overall quality.

10 comments7 min readLW link

[Question] Is a random box of gas predictable after 20 seconds?

Thomas Kwa and habryka

Jan 24, 2024, 11:00 PM

38 points

14 votes

Overall karma indicates overall quality.

35 comments1 min readLW link

[Question] Will quantum randomness affect the 2028 election?

Thomas Kwa and habryka

Jan 24, 2024, 10:54 PM

66 points

26 votes

Overall karma indicates overall quality.

52 comments1 min readLW link

Thomas Kwa’s research journal

Thomas Kwa and Adrià Garriga-alonso

Nov 23, 2023, 5:11 AM

79 points

37 votes

Overall karma indicates overall quality.

1 comment6 min readLW link

Thomas Kwa’s MIRI research experience

Thomas Kwa, peterbarnett, Vivek Hebbar, Jeremy Gillen, Bird Concept and Raemon

Oct 2, 2023, 4:42 PM

174 points

94 votes

Overall karma indicates overall quality.

53 comments1 min readLW link

Catastrophic Regressional Goodhart: Appendix

Thomas Kwa and Drake Thomas

May 15, 2023, 12:10 AM

25 points

11 votes

Overall karma indicates overall quality.

1 comment9 min readLW link

When is Goodhart catastrophic?

Drake Thomas and Thomas Kwa

May 9, 2023, 3:59 AM

180 points

68 votes

Overall karma indicates overall quality.

30 comments8 min readLW link 1 review

Challenge: construct a Gradient Hacker

Thomas Larsen and Thomas Kwa

Mar 9, 2023, 2:38 AM

39 points

18 votes

Overall karma indicates overall quality.

10 comments1 min readLW link

Failure modes in a shard theory alignment plan

Thomas KwaSep 27, 2022, 10:34 PM

26 points

12 votes

Overall karma indicates overall quality.

2 comments7 min readLW link

Utility functions and probabilities are entangled

Thomas KwaJul 26, 2022, 5:36 AM

15 points

7 votes

Overall karma indicates overall quality.

5 comments1 min readLW link

Deriving Conditional Expected Utility from Pareto-Efficient Decisions

Thomas KwaMay 5, 2022, 3:21 AM

24 points

8 votes

Overall karma indicates overall quality.

1 comment6 min readLW link

Most problems don’t differ dramatically in tractability (under certain assumptions)

Thomas KwaMay 4, 2022, 12:05 AM

8 points

3 votes

Overall karma indicates overall quality.

0 comments3 min readLW link

The case for turning glowfic into Sequences

Thomas KwaApr 27, 2022, 6:58 AM

88 points

47 votes

Overall karma indicates overall quality.

29 comments5 min readLW link

[Question] (When) do high-dimensional spaces have linear paths down to local minima?

Thomas KwaApr 22, 2022, 3:35 PM

12 points

5 votes

Overall karma indicates overall quality.

7 comments1 min readLW link

Keyboard shortcuts

Keys shown in yellow (e.g., ]) are accesskeys, and require a browser-specific modifier key (or keys).

Keys shown in grey (e.g., ?) do not require any modifier keys.

General
? Show keyboard shortcuts
Esc Hide keyboard shortcuts

Site navigation
h Go to Home (a.k.a. “Frontpage”) view
f Go to Featured (a.k.a. “Curated”) view
a Go to All (a.k.a. “Community”) view
m Go to Meta view
v Go to Tags view
c Go to Recent Comments view
r Go to Archive view
q Go to Sequences view
t Go to About page
u Go to User or Login page
o Go to Inbox page

Page navigation
, Jump up to top of page
. Jump down to bottom of page
/ Jump to top of comments section
s Search

Page actions
n New post or comment
e Edit current post

Post/comment list views
. Focus next entry in list
, Focus previous entry in list
; Cycle between links in focused entry
Enter Go to currently focused entry
Esc Unfocus currently focused entry
] Go to next page
[ Go to previous page
\ Go to first page
e Edit currently focused post

Editor
k Bold text
i Italic text
l Insert hyperlink
q Blockquote text

Appearance
= Increase text size
- Decrease text size
0 Reset to default text size
′ Cycle through content width settings
1 Switch to default theme [A]
2 Switch to dark theme [B]
3 Switch to grey theme [C]
4 Switch to ultramodern theme [D]
5 Switch to simple theme [E]
6 Switch to brutalist theme [F]
7 Switch to ReadTheSequences theme [G]
8 Switch to classic Less Wrong theme [H]
9 Switch to modern Less Wrong theme [I]
; Open theme tweaker
Enter Save changes and close theme tweaker
Esc Close theme tweaker (without saving)

Slide shows
l Start/resume slideshow
Esc Exit slideshow
→↓ Next slide
←↑ Previous slide
Space Reset slide zoom

Miscellaneous
x Switch to next view on user page
z Switch to previous view on user page
` Toggle compact comment list view
g Toggle anti-kibitzer