peterbarnett

Karma: 3,492

Researcher at MIRI

https://peterbarnett.org/

Considerations for setting the FLOP thresholds in our example international AI agreement

Aaron_Scher and peterbarnett

18 Nov 2025 23:31 UTC

52 points

5 comments7 min readLW link

New Report: An International Agreement to Prevent the Premature Creation of Artificial Superintelligence

peterbarnett, Aaron_Scher, David Abecassis and Brian Abeyta

18 Nov 2025 19:09 UTC

211 points

22 comments3 min readLW link

AI Generated Podcast of the 2021 MIRI Conversations

peterbarnett10 Sep 2025 15:01 UTC

37 points

0 comments1 min readLW link

AI Governance to Avoid Extinction: The Strategic Landscape and Actionable Research Questions

peterbarnett and Aaron_Scher

1 May 2025 22:46 UTC

109 points

7 comments8 min readLW link

(techgov.intelligence.org)

Without fundamental advances, misalignment and catastrophe are the default outcomes of training powerful AI

Jeremy Gillen and peterbarnett

26 Jan 2024 7:22 UTC

161 points

60 comments57 min readLW link

Trying to align humans with inclusive genetic fitness

peterbarnett11 Jan 2024 0:13 UTC

23 points

5 comments10 min readLW link

Labs should be explicit about why they are building AGI

peterbarnett17 Oct 2023 21:09 UTC

215 points

18 comments1 min readLW link 1 review

Thomas Kwa’s MIRI research experience

Thomas Kwa, peterbarnett, Vivek Hebbar, Jeremy Gillen, Bird Concept and Raemon

2 Oct 2023 16:42 UTC

175 points

53 comments1 min readLW link

Doing oversight from the very start of training seems hard

peterbarnett20 Sep 2022 17:21 UTC

14 points

3 comments3 min readLW link

Confusions in My Model of AI Risk

peterbarnett7 Jul 2022 1:05 UTC

22 points

9 comments5 min readLW link

Scott Aaronson is joining OpenAI to work on AI safety

peterbarnett18 Jun 2022 4:06 UTC

117 points

31 comments1 min readLW link

(scottaaronson.blog)

A Story of AI Risk: InstructGPT-N

peterbarnett26 May 2022 23:22 UTC

24 points

0 comments8 min readLW link

Why I’m Worried About AI

peterbarnett23 May 2022 21:13 UTC

22 points

2 comments12 min readLW link

Framings of Deceptive Alignment

peterbarnett26 Apr 2022 4:25 UTC

32 points

7 comments5 min readLW link

How to become an AI safety researcher

peterbarnett15 Apr 2022 11:41 UTC

25 points

0 comments14 min readLW link

Thoughts on Dangerous Learned Optimization

peterbarnett19 Feb 2022 10:46 UTC

4 points

2 comments4 min readLW link

peterbarnett’s Shortform

peterbarnett16 Feb 2022 17:24 UTC

3 points

96 comments1 min readLW link

Alignment Problems All the Way Down

peterbarnett22 Jan 2022 0:19 UTC

30 points

8 comments11 min readLW link

[Question] What questions do you have about doing work on AI safety?

peterbarnett21 Dec 2021 16:36 UTC

13 points

8 comments1 min readLW link

Some motivations to gradient hack

peterbarnett17 Dec 2021 3:06 UTC

8 points

0 comments6 min readLW link