[Question] Se­ri­ously, what goes wrong with “re­ward the agent when it makes you smile”?

TurnTrout11 Aug 2022 22:22 UTC
86 points
42 comments2 min readLW link

En­cul­tured AI Pre-plan­ning, Part 2: Pro­vid­ing a Service

11 Aug 2022 20:11 UTC
33 points
4 comments3 min readLW link

My sum­mary of the al­ign­ment problem

Peter Hroššo11 Aug 2022 19:42 UTC
16 points
3 comments2 min readLW link
(threadreaderapp.com)

Lan­guage mod­els seem to be much bet­ter than hu­mans at next-to­ken prediction

11 Aug 2022 17:45 UTC
182 points
59 comments13 min readLW link1 review

In­tro­duc­ing Past­cast­ing: A tool for fore­cast­ing practice

Sage Future11 Aug 2022 17:38 UTC
95 points
10 comments2 min readLW link2 reviews

Pen­du­lums, Policy-Level De­ci­sion­mak­ing, Sav­ing State

CFAR!Duncan11 Aug 2022 16:47 UTC
26 points
3 comments8 min readLW link

Covid 8/​11/​22: The End Is Never The End

Zvi11 Aug 2022 16:20 UTC
28 points
11 comments16 min readLW link
(thezvi.wordpress.com)

Sin­ga­pore—Small ca­sual din­ner in Chi­na­town #4

Joe Rocca11 Aug 2022 12:30 UTC
3 points
3 comments1 min readLW link

Thoughts on the good reg­u­la­tor theorem

JonasMoss11 Aug 2022 12:08 UTC
12 points
0 comments4 min readLW link

How and why to turn ev­ery­thing into audio

11 Aug 2022 8:55 UTC
54 points
20 comments5 min readLW link

Shard The­ory: An Overview

David Udell11 Aug 2022 5:44 UTC
161 points
34 comments10 min readLW link

[Question] Do ad­vance­ments in De­ci­sion The­ory point to­wards moral ab­solutism?

Nathan112311 Aug 2022 0:59 UTC
0 points
4 comments4 min readLW link

The al­ign­ment prob­lem from a deep learn­ing perspective

Richard_Ngo10 Aug 2022 22:46 UTC
107 points
15 comments27 min readLW link1 review

How much al­ign­ment data will we need in the long run?

Jacob_Hilton10 Aug 2022 21:39 UTC
37 points
15 comments4 min readLW link

On Ego, Rein­car­na­tion, Con­scious­ness and The Uni­verse

qmaury10 Aug 2022 20:21 UTC
−3 points
6 comments5 min readLW link

For­mal­iz­ing Alignment

Marv K10 Aug 2022 18:50 UTC
4 points
0 comments2 min readLW link

How Do We Align an AGI Without Get­ting So­cially Eng­ineered? (Hint: Box It)

10 Aug 2022 18:14 UTC
28 points
30 comments11 min readLW link

Emer­gent Abil­ities of Large Lan­guage Models [Linkpost]

aogara10 Aug 2022 18:02 UTC
25 points
2 comments1 min readLW link
(arxiv.org)

How To Go From In­ter­pretabil­ity To Align­ment: Just Re­tar­get The Search

johnswentworth10 Aug 2022 16:08 UTC
179 points
33 comments3 min readLW link1 review

Us­ing GPT-3 to aug­ment hu­man intelligence

Henrik Karlsson10 Aug 2022 15:54 UTC
52 points
8 comments18 min readLW link
(escapingflatland.substack.com)

ACX meetup [Au­gust]

sallatik10 Aug 2022 9:54 UTC
1 point
1 comment1 min readLW link

Dissent Collusion

Screwtape10 Aug 2022 2:43 UTC
19 points
0 comments3 min readLW link

The Medium Is The Bandage

party girl10 Aug 2022 1:45 UTC
11 points
0 comments10 min readLW link

[Question] Why is in­creas­ing pub­lic aware­ness of AI safety not a pri­or­ity?

FinalFormal210 Aug 2022 1:28 UTC
−5 points
14 comments1 min readLW link

Man­i­fold x CSPI $25k Fore­cast­ing Tournament

David Chee9 Aug 2022 21:13 UTC
5 points
0 comments1 min readLW link
(www.cspicenter.com)

Pro­posal: Con­sider not us­ing dis­tance-di­rec­tion-di­men­sion words in ab­stract discussions

moridinamael9 Aug 2022 20:44 UTC
45 points
18 comments5 min readLW link

[Question] How would two su­per­in­tel­li­gent AIs in­ter­act, if they are un­al­igned with each other?

Nathan11239 Aug 2022 18:58 UTC
4 points
6 comments1 min readLW link

Disagree­ments about Align­ment: Why, and how, we should try to solve them

ojorgensen9 Aug 2022 18:49 UTC
11 points
2 comments16 min readLW link

Progress links and tweets, 2022-08-09

jasoncrawford9 Aug 2022 17:35 UTC
11 points
3 comments1 min readLW link
(rootsofprogress.org)

[Question] Is it pos­si­ble to find ven­ture cap­i­tal for AI re­search org with strong safety fo­cus?

AnonResearch9 Aug 2022 16:12 UTC
6 points
1 comment1 min readLW link

[Question] Many Gods re­fu­ta­tion and In­stru­men­tal Goals. (Proper one)

aditya malik9 Aug 2022 11:59 UTC
0 points
15 comments1 min readLW link

Con­tent gen­er­a­tion. Where do we draw the line?

Q Home9 Aug 2022 10:51 UTC
6 points
7 comments2 min readLW link

[Question] What are some al­ter­na­tives to Shap­ley val­ues which drop ad­di­tivity?

eapi9 Aug 2022 9:16 UTC
11 points
6 comments1 min readLW link
(math.stackexchange.com)

Ra­dio Bostrom: Au­dio nar­ra­tions of pa­pers by Nick Bostrom

PeterH9 Aug 2022 8:56 UTC
12 points
0 comments2 min readLW link
(forum.effectivealtruism.org)

Team Shard Sta­tus Report

David Udell9 Aug 2022 5:33 UTC
38 points
8 comments3 min readLW link

An­nounc­ing: Mechanism De­sign for AI Safety—Read­ing Group

Rubi J. Hudson9 Aug 2022 4:21 UTC
18 points
3 comments4 min readLW link

[Question] What are some Works that might be use­ful but are difficult, so for­got­ten?

TekhneMakre9 Aug 2022 2:22 UTC
10 points
5 comments1 min readLW link

Pro­ject pro­posal: Test­ing the IBP defi­ni­tion of agent

9 Aug 2022 1:09 UTC
21 points
4 comments2 min readLW link

How (not) to choose a re­search project

9 Aug 2022 0:26 UTC
78 points
11 comments7 min readLW link

[Question] Are ya win­ning, son?

Nathan11239 Aug 2022 0:06 UTC
14 points
13 comments2 min readLW link

Gen­eral al­ign­ment properties

TurnTrout8 Aug 2022 23:40 UTC
50 points
2 comments1 min readLW link

Ex­per­i­ment: Be my math tu­tor?

sudo8 Aug 2022 22:50 UTC
12 points
5 comments1 min readLW link

En­cul­tured AI, Part 1 Ap­pendix: Rele­vant Re­search Examples

8 Aug 2022 22:44 UTC
11 points
1 comment7 min readLW link

En­cul­tured AI Pre-plan­ning, Part 1: En­abling New Benchmarks

8 Aug 2022 22:44 UTC
63 points
2 comments6 min readLW link

Broad Bas­ins and Data Compression

8 Aug 2022 20:33 UTC
33 points
6 comments7 min readLW link

In­ter­pretabil­ity/​Tool-ness/​Align­ment/​Cor­rigi­bil­ity are not Composable

johnswentworth8 Aug 2022 18:05 UTC
129 points
12 comments3 min readLW link

LW Meetup @ DEFCON (Las Ve­gas) − 5-7pm Thu. Aug. 11 at Fo­rum Food Court (Cae­sars)

jchan8 Aug 2022 14:57 UTC
6 points
0 comments1 min readLW link

A suffi­ciently para­noid pa­per­clip maximizer

RomanS8 Aug 2022 11:17 UTC
17 points
10 comments2 min readLW link

[Question] In­stru­men­tal Goals and Many Gods Re­fu­ta­tion

aditya malik8 Aug 2022 10:46 UTC
−10 points
4 comments1 min readLW link

Area un­der the curve, Eat Dirt, Broc­coli Er­rors, Coper­ni­cus & Chaos

CFAR!Duncan8 Aug 2022 8:17 UTC
36 points
0 comments7 min readLW link