Ad­ver­sar­ial Training

Ad­ver­sar­ial Ro­bust­ness Could Help Prevent Catas­trophic Misuse

Some thoughts on why ad­ver­sar­ial train­ing might be useful

Solv­ing ad­ver­sar­ial at­tacks in com­puter vi­sion as a baby ver­sion of gen­eral AI alignment

Iron­ing Out the Squiggles

Can Gen­er­al­ized Ad­ver­sar­ial Test­ing En­able More Ri­gor­ous LLM Safety Evals?

Be­hav­ioral red-team­ing is un­likely to pro­duce clear, strong ev­i­dence that mod­els aren’t scheming

High-stakes al­ign­ment via ad­ver­sar­ial train­ing [Red­wood Re­search re­port]

AI Safety 101 - Chap­ter 5.2 - Un­re­stricted Ad­ver­sar­ial Training

Deep For­get­ting & Un­learn­ing for Safely-Scoped LLMs

Ad­ver­sar­ial train­ing, im­por­tance sam­pling, and anti-ad­ver­sar­ial train­ing for AI whistleblowing

AXRP Epi­sode 17 - Train­ing for Very High Reli­a­bil­ity with Daniel Ziegler

Take­aways from our ro­bust in­jury clas­sifier pro­ject [Red­wood Re­search]

Con­tin­u­ous Ad­ver­sar­ial Qual­ity As­surance: Ex­tend­ing RLHF and Con­sti­tu­tional AI

Beyond the Board: Ex­plor­ing AI Ro­bust­ness Through Go

La­tent Ad­ver­sar­ial Train­ing (LAT) Im­proves the Rep­re­sen­ta­tion of Refusal

Does ro­bust­ness im­prove with scale?

EIS XI: Mov­ing Forward

La­tent Ad­ver­sar­ial Training

EIS XII: Sum­mary

Over­sight Leagues: The Train­ing Game as a Feature

EIS IX: In­ter­pretabil­ity and Adversaries