Su­per­in­tel­li­gence’s goals are likely to be random

Mikhail SaminMar 13, 2025, 10:41 PM
6 points
6 comments5 min readLW link

Should AI safety be a mass move­ment?

mhamptonMar 13, 2025, 8:36 PM
5 points
1 comment4 min readLW link

Au­dit­ing lan­guage mod­els for hid­den objectives

Mar 13, 2025, 7:18 PM
141 points
15 comments13 min readLW link

Re­duc­ing LLM de­cep­tion at scale with self-other over­lap fine-tuning

Mar 13, 2025, 7:09 PM
155 points
41 comments6 min readLW link

Vacuum De­cay: Ex­pert Sur­vey Results

JessRiedelMar 13, 2025, 6:31 PM
96 points
26 commentsLW link

A Fron­tier AI Risk Man­age­ment Frame­work: Bridg­ing the Gap Between Cur­rent AI Prac­tices and Estab­lished Risk Management

Mar 13, 2025, 6:29 PM
10 points
0 comments1 min readLW link
(arxiv.org)

Creat­ing Com­plex Goals: A Model to Create Au­tonomous Agents

theravenMar 13, 2025, 6:17 PM
6 points
1 comment6 min readLW link

Haber­mas Machine

NicholasKeesMar 13, 2025, 6:16 PM
49 points
7 comments6 min readLW link
(mosaic-labs.org)

The Other Align­ment Prob­lem: Maybe AI Needs Pro­tec­tion From Us

PeterpiperMar 13, 2025, 6:03 PM
−3 points
0 comments3 min readLW link

AI #107: The Mis­placed Hype Machine

ZviMar 13, 2025, 2:40 PM
47 points
10 comments40 min readLW link
(thezvi.wordpress.com)

In­tel­sat as a Model for In­ter­na­tional AGI Governance

Mar 13, 2025, 12:58 PM
45 points
0 comments1 min readLW link
(www.forethought.org)

Stac­ity: a Lock-In Risk Bench­mark for Large Lan­guage Models

alamertonMar 13, 2025, 12:08 PM
4 points
0 comments1 min readLW link
(huggingface.co)

The prospect of ac­cel­er­ated AI safety progress, in­clud­ing philo­soph­i­cal progress

Mitchell_PorterMar 13, 2025, 10:52 AM
11 points
0 comments4 min readLW link

The “Rev­er­sal Curse”: you still aren’t antropo­mor­phis­ing enough.

lumpenspaceMar 13, 2025, 10:24 AM
3 points
0 comments1 min readLW link
(lumpenspace.substack.com)

For­mal­iz­ing Space-Far­ing Civ­i­liza­tions Sat­u­ra­tion con­cepts and metrics

Maxime RichéMar 13, 2025, 9:40 AM
4 points
0 comments8 min readLW link

The Eco­nomics of p(doom)

Jakub GrowiecMar 13, 2025, 7:33 AM
2 points
0 comments1 min readLW link

So­cial Me­dia: How to fix them be­fore they be­come the biggest news platform

Sam GMar 13, 2025, 7:28 AM
5 points
2 comments3 min readLW link

Penny Whis­tle in E?

jefftkMar 13, 2025, 2:40 AM
9 points
1 comment1 min readLW link
(www.jefftk.com)

An­thropic, and tak­ing “tech­ni­cal philos­o­phy” more seriously

RaemonMar 13, 2025, 1:48 AM
125 points
29 comments11 min readLW link

LW/​ACX So­cial Meetup

StefanMar 12, 2025, 11:13 PM
2 points
0 comments1 min readLW link

I grade ev­ery NBA bas­ket­ball game I watch based on enjoyability

proshowersingerMar 12, 2025, 9:46 PM
24 points
2 comments4 min readLW link

Kairos is hiring a Head of Oper­a­tions/​Found­ing Generalist

agucovaMar 12, 2025, 8:58 PM
6 points
0 commentsLW link

USAID Out­look: A Me­tac­u­lus Fore­cast­ing Series

ChristianWilliamsMar 12, 2025, 8:34 PM
9 points
0 commentsLW link
(www.metaculus.com)

What is in­stru­men­tal con­ver­gence?

Mar 12, 2025, 8:28 PM
2 points
0 comments2 min readLW link
(aisafety.info)

Re­vis­ing Stages-Over­sight Re­veals Greater Si­tu­a­tional Aware­ness in LLMs

Sanyu RajakumarMar 12, 2025, 5:56 PM
16 points
0 comments13 min readLW link

Why Obe­di­ent AI May Be the Real Catastrophe

G~Mar 12, 2025, 5:50 PM
5 points
2 comments3 min readLW link

Your Com­mu­ni­ca­tion Prefer­ences Aren’t Law

Jonathan MoregårdMar 12, 2025, 5:20 PM
25 points
4 comments1 min readLW link
(honestliving.substack.com)

Reflec­tions on Neuralese

Alice BlairMar 12, 2025, 4:29 PM
28 points
0 comments5 min readLW link

Field tests of semi-ra­tio­nal­ity in Brazilian mil­i­tary training

P. JoãoMar 12, 2025, 4:14 PM
31 points
0 comments2 min readLW link

Many life-sav­ing drugs fail for lack of fund­ing. But there’s a solu­tion: des­per­ate rich people

MvolzMar 12, 2025, 3:24 PM
17 points
0 comments1 min readLW link
(www.theguardian.com)

The Most For­bid­den Technique

ZviMar 12, 2025, 1:20 PM
143 points
9 comments17 min readLW link
(thezvi.wordpress.com)

You don’t ac­tu­ally need a phys­i­cal mul­ti­verse to ex­plain an­thropic fine-tun­ing.

FraserMar 12, 2025, 7:33 AM
7 points
8 comments3 min readLW link
(frvser.com)

AI Can’t Write Good Fiction

JustisMillsMar 12, 2025, 6:11 AM
38 points
24 comments7 min readLW link
(justismills.substack.com)

Ex­ist­ing UDTs test the limits of Bayesi­anism (and con­sis­tency)

Cole WyethMar 12, 2025, 4:09 AM
28 points
21 comments7 min readLW link

(Anti)Aging 101

George3d6Mar 12, 2025, 3:59 AM
5 points
2 comments3 min readLW link
(cerebralab.com)

The Grapes of Hardness

adamShimiMar 11, 2025, 9:01 PM
8 points
0 comments5 min readLW link
(formethods.substack.com)

Don’t over-up­date on Fron­tierMath results

David MatolcsiMar 11, 2025, 8:44 PM
51 points
7 comments9 min readLW link

Re­sponse to Scott Alexan­der on Imprisonment

ZviMar 11, 2025, 8:40 PM
40 points
4 comments9 min readLW link
(thezvi.wordpress.com)

Paths and waysta­tions in AI safety

Joe CarlsmithMar 11, 2025, 6:52 PM
41 points
1 comment11 min readLW link
(joecarlsmith.substack.com)

Meri­dian Cam­bridge Visit­ing Re­searcher Pro­gramme: Turn AI safety ideas into funded pro­jects in one week!

Meridian CambridgeMar 11, 2025, 5:46 PM
13 points
0 comments2 min readLW link

Elon Musk May Be Tran­si­tion­ing to Bipo­lar Type I

Cyborg25Mar 11, 2025, 5:45 PM
83 points
22 comments4 min readLW link

Scal­ing AI Reg­u­la­tion: Real­is­ti­cally, what Can (and Can’t) Be Reg­u­lated?

Katalina HernandezMar 11, 2025, 4:51 PM
3 points
1 comment3 min readLW link

How Lan­guage Models Un­der­stand Nullability

Mar 11, 2025, 3:57 PM
5 points
0 comments2 min readLW link
(dmodel.ai)

Forethought: a new AI macros­trat­egy group

Mar 11, 2025, 3:39 PM
18 points
0 comments3 min readLW link

Prepar­ing for the In­tel­li­gence Explosion

Mar 11, 2025, 3:38 PM
78 points
17 comments1 min readLW link
(www.forethought.org)

stop solv­ing prob­lems that have already been solved

dhruvmethiMar 11, 2025, 3:30 PM
10 points
3 comments8 min readLW link

AI Con­trol May In­crease Ex­is­ten­tial Risk

Jan_KulveitMar 11, 2025, 2:30 PM
98 points
13 comments1 min readLW link

When is it Bet­ter to Train on the Align­ment Proxy?

dil-leik-ogMar 11, 2025, 1:35 PM
14 points
0 comments9 min readLW link

A differ­ent take on the Musk v OpenAI pre­limi­nary in­junc­tion order

TFDMar 11, 2025, 12:46 PM
8 points
0 comments20 min readLW link
(www.thefloatingdroid.com)

Do rea­son­ing mod­els use their scratch­pad like we do? Ev­i­dence from dis­till­ing paraphrases

Fabien RogerMar 11, 2025, 11:52 AM
121 points
23 comments11 min readLW link
(alignment.anthropic.com)