Stuart_Armstrong(Stuart Armstrong)

Hu­mans are stun­ningly ra­tio­nal and stun­ningly irrational

Knowl­edge, ma­nipu­la­tion, and free will

De­hu­man­i­sa­tion *er­rors*

An­thro­po­mor­phi­sa­tion vs value learn­ing: type 1 vs type 2 errors

Tech­ni­cal model re­fine­ment formalism

Model splin­ter­ing: mov­ing from one im­perfect model to another

Learn­ing hu­man prefer­ences: black-box, white-box, and struc­tured white-box access

AI safety as feather­less bipeds *with broad flat nails*

Learn­ing hu­man prefer­ences: op­ti­mistic and pes­simistic scenarios

Strong im­pli­ca­tion of prefer­ence uncertainty

“Go west, young man!”—Prefer­ences in (im­perfect) maps

Learn­ing Values in Practice

The Gold­bach con­jec­ture is prob­a­bly cor­rect; so was Fer­mat’s last theorem

Why is the im­pact penalty time-in­con­sis­tent?

Dy­namic in­con­sis­tency of the in­ac­tion and ini­tial state baseline

Models, myths, dreams, and Cheshire cat grins

Re­sults of $1,000 Or­a­cle con­test!

Com­par­ing re­ward learn­ing/​re­ward tam­per­ing formalisms

Prob­a­bil­ities, weights, sums: pretty much the same for re­ward functions

Learn­ing and ma­nipu­lat­ing learning