Geoffrey Irving

Karma: 717

Chief Scientist at the UK AI Safety Institute (AISI). Previously, DeepMind, OpenAI, Google Brain, etc.

Unexploitable search: blocking malicious use of free parameters

Jacob Pfau and Geoffrey Irving

May 21, 2025, 5:23 PM

34 points

16 comments6 min readLW link

Dodging systematic human errors in scalable oversight

Geoffrey IrvingMay 14, 2025, 3:19 PM

33 points

3 comments4 min readLW link

An alignment safety case sketch based on debate

Marie_DB, Jacob Pfau, Benjamin Hilton and Geoffrey Irving

May 8, 2025, 3:02 PM

57 points

19 comments25 min readLW link

(arxiv.org)

UK AISI’s Alignment Team: Research Agenda

Benjamin Hilton, Jacob Pfau, Marie_DB and Geoffrey Irving

May 7, 2025, 4:33 PM

109 points

2 comments11 min readLW link

How to evaluate control measures for LLM agents? A trajectory from today to superintelligence

Tomek Korbak, Mikita Balesni, Buck and Geoffrey Irving

Apr 14, 2025, 4:45 PM

29 points

1 comment2 min readLW link

Prospects for Alignment Automation: Interpretability Case Study

Jacob Pfau and Geoffrey Irving

Mar 21, 2025, 2:05 PM

32 points

5 comments8 min readLW link

A sketch of an AI control safety case

Tomek Korbak, joshc, Benjamin Hilton, Buck and Geoffrey Irving

Jan 30, 2025, 5:28 PM

57 points

0 comments5 min readLW link

Eliciting bad contexts

Geoffrey Irving, Joseph Bloom and Tomek Korbak

Jan 24, 2025, 10:39 AM

31 points

8 comments3 min readLW link

Automation collapse

Geoffrey Irving, Tomek Korbak and Benjamin Hilton

Oct 21, 2024, 2:50 PM

72 points

9 comments7 min readLW link

Debate, Oracles, and Obfuscated Arguments

Jonah Brown-Cohen and Geoffrey Irving

Jun 20, 2024, 11:14 PM

44 points

4 comments21 min readLW link

Does Circuit Analysis Interpretability Scale? Evidence from Multiple Choice Capabilities in Chinchilla

Neel Nanda, Tom Lieberum, Matthew Rahtz, János Kramár, Geoffrey Irving, Rohin Shah and Vlad Mikulik

Jul 20, 2023, 10:50 AM

44 points

3 comments2 min readLW link

(arxiv.org)

DeepMind is hiring for the Scalable Alignment and Alignment Teams

Rohin Shah and Geoffrey Irving

May 13, 2022, 12:17 PM

150 points

34 comments9 min readLW link

Learning the smooth prior

Geoffrey Irving, Rohin Shah and evhub

Apr 29, 2022, 9:10 PM

35 points

0 comments12 min readLW link