RSS

János Kramár

Karma: 531

Nega­tive Re­sults for SAEs On Down­stream Tasks and Depri­ori­tis­ing SAE Re­search (GDM Mech In­terp Team Progress Up­date #2)

lewis smith, Senthooran Rajamanoharan, Arthur Conmy, CallumMcDougall, Tom Lieberum, János Kramár, Rohin Shah and Neel Nanda
Mar 26, 2025, 7:07 PM
113 points
15 comments29 min readLW link
(deepmindsafetyresearch.medium.com)

JumpReLU SAEs + Early Ac­cess to Gemma 2 SAEs

Senthooran Rajamanoharan, Tom Lieberum, nps29, Arthur Conmy, Vikrant Varma, János Kramár and Neel Nanda
Jul 19, 2024, 4:10 PM
49 points
10 comments1 min readLW link
(storage.googleapis.com)

Im­prov­ing Dic­tionary Learn­ing with Gated Sparse Autoencoders

Senthooran Rajamanoharan, Arthur Conmy, lewis smith, Tom Lieberum, Vikrant Varma, János Kramár, Rohin Shah and Neel Nanda
Apr 25, 2024, 6:43 PM
63 points
38 comments1 min readLW link
(arxiv.org)

[Full Post] Progress Up­date #1 from the GDM Mech In­terp Team

Neel Nanda, Arthur Conmy, lewis smith, Senthooran Rajamanoharan, Tom Lieberum, János Kramár and Vikrant Varma
Apr 19, 2024, 7:06 PM
79 points
10 comments8 min readLW link

[Sum­mary] Progress Up­date #1 from the GDM Mech In­terp Team

Neel Nanda, Arthur Conmy, lewis smith, Senthooran Rajamanoharan, Tom Lieberum, János Kramár and Vikrant Varma
Apr 19, 2024, 7:06 PM
72 points
0 comments3 min readLW link

AtP*: An effi­cient and scal­able method for lo­cal­iz­ing LLM be­havi­our to components

Neel Nanda, János Kramár, Tom Lieberum and Rohin Shah
Mar 18, 2024, 5:28 PM
19 points
0 comments1 min readLW link
(arxiv.org)

Fact Find­ing: Do Early Lay­ers Spe­cial­ise in Lo­cal Pro­cess­ing? (Post 5)

Neel Nanda, Senthooran Rajamanoharan, János Kramár and Rohin Shah
Dec 23, 2023, 2:46 AM
18 points
0 comments4 min readLW link

Fact Find­ing: How to Think About In­ter­pret­ing Me­mori­sa­tion (Post 4)

Senthooran Rajamanoharan, Neel Nanda, János Kramár and Rohin Shah
Dec 23, 2023, 2:46 AM
22 points
0 comments9 min readLW link

Fact Find­ing: Try­ing to Mechanis­ti­cally Un­der­stand­ing Early MLPs (Post 3)

Neel Nanda, Senthooran Rajamanoharan, János Kramár and Rohin Shah
Dec 23, 2023, 2:46 AM
10 points
1 comment16 min readLW link

Fact Find­ing: Sim­plify­ing the Cir­cuit (Post 2)

Senthooran Rajamanoharan, Neel Nanda, János Kramár and Rohin Shah
Dec 23, 2023, 2:45 AM
25 points
3 comments14 min readLW link

Fact Find­ing: At­tempt­ing to Re­v­erse-Eng­ineer Fac­tual Re­call on the Neu­ron Level (Post 1)

Neel Nanda, Senthooran Rajamanoharan, János Kramár and Rohin Shah
Dec 23, 2023, 2:44 AM
106 points
10 comments22 min readLW link2 reviews

Does Cir­cuit Anal­y­sis In­ter­pretabil­ity Scale? Ev­i­dence from Mul­ti­ple Choice Ca­pa­bil­ities in Chinchilla

Neel Nanda, Tom Lieberum, Matthew Rahtz, János Kramár, Geoffrey Irving, Rohin Shah and Vlad Mikulik
Jul 20, 2023, 10:50 AM
44 points
3 comments2 min readLW link
(arxiv.org)

In­finite Mo­dal Com­bat: some observations

János KramárJul 29, 2015, 4:05 AM
3 points
0 comments3 min readLW link

A tractable, in­ter­pretable for­mu­la­tion of ap­prox­i­mate con­di­tion­ing for pair­wise-speci­fied prob­a­bil­ity dis­tri­bu­tions over truth values

János KramárJun 3, 2015, 7:08 PM
3 points
3 comments2 min readLW link