Com­par­ing rep­re­sen­ta­tion vec­tors be­tween llama 2 base and chat

Nina Rimsky28 Oct 2023 22:54 UTC
36 points
5 comments2 min readLW link

Vaniver’s thoughts on An­thropic’s RSP

Vaniver28 Oct 2023 21:06 UTC
46 points
4 comments3 min readLW link

Book Re­view: Oral­ity and Liter­acy: The Tech­nol­o­giz­ing of the Word

Fergus Fettes28 Oct 2023 20:12 UTC
13 points
0 comments16 min readLW link

Re­grant up to $600,000 to AI safety pro­jects with GiveWiki

Dawn Drescher28 Oct 2023 19:56 UTC
33 points
1 comment1 min readLW link

Shane Legg in­ter­view on alignment

Seth Herd28 Oct 2023 19:28 UTC
66 points
20 comments2 min readLW link
(www.youtube.com)

AI Ex­is­ten­tial Safety Fellowships

mmfli28 Oct 2023 18:07 UTC
5 points
0 comments1 min readLW link

AI Safety Hub Ser­bia Offi­cial Opening

28 Oct 2023 17:03 UTC
51 points
0 comments3 min readLW link
(forum.effectivealtruism.org)

Manag­ing AI Risks in an Era of Rapid Progress

Algon28 Oct 2023 15:48 UTC
30 points
3 comments11 min readLW link
(managing-ai-risks.com)

[Question] ELI5 Why isn’t al­ign­ment *eas­ier* as mod­els get stronger?

Logan Zoellner28 Oct 2023 14:34 UTC
3 points
9 comments1 min readLW link

Truth­seek­ing, EA, Si­mu­lacra lev­els, and other stuff

27 Oct 2023 23:56 UTC
44 points
12 comments9 min readLW link

[Question] Do you be­lieve “E=mc^2” is a cor­rect and/​or use­ful equa­tion, and, whether yes or no, pre­cisely what are your rea­sons for hold­ing this be­lief (with such a de­gree of con­fi­dence)?

l8c27 Oct 2023 22:46 UTC
10 points
14 comments1 min readLW link

Value sys­tem­ati­za­tion: how val­ues be­come co­her­ent (and mis­al­igned)

Richard_Ngo27 Oct 2023 19:06 UTC
95 points
47 comments13 min readLW link

Techno-hu­man­ism is techno-op­ti­mism for the 21st century

Richard_Ngo27 Oct 2023 18:37 UTC
88 points
5 comments14 min readLW link
(www.mindthefuture.info)

Sanc­tu­ary for Humans

nikola27 Oct 2023 18:08 UTC
21 points
9 comments1 min readLW link

Wire­head­ing and mis­al­ign­ment by com­po­si­tion on NetHack

pierlucadoro27 Oct 2023 17:43 UTC
34 points
4 comments4 min readLW link

We’re Not Ready: thoughts on “paus­ing” and re­spon­si­ble scal­ing policies

HoldenKarnofsky27 Oct 2023 15:19 UTC
199 points
33 comments8 min readLW link

Aspira­tion-based Q-Learning

27 Oct 2023 14:42 UTC
38 points
5 comments11 min readLW link

Linkpost: Rishi Su­nak’s Speech on AI (26th Oc­to­ber)

bideup27 Oct 2023 11:57 UTC
85 points
8 comments7 min readLW link
(www.gov.uk)

ASPR & WARP: Ra­tion­al­ity Camps for Teens in Taiwan and Oxford

Anna Gajdova27 Oct 2023 8:40 UTC
18 points
0 comments1 min readLW link

[Question] To what ex­tent is the UK Govern­ment’s re­cent AI Safety push en­tirely due to Rishi Su­nak?

Stephen Fowler27 Oct 2023 3:29 UTC
23 points
4 comments1 min readLW link

Bayesian Punishment

Rob Lucas27 Oct 2023 3:24 UTC
1 point
1 comment6 min readLW link

On­line Dialogues Party — Sun­day 5th November

Ben Pace27 Oct 2023 2:41 UTC
28 points
1 comment1 min readLW link

OpenAI’s new Pre­pared­ness team is hiring

leopold26 Oct 2023 20:42 UTC
60 points
2 comments1 min readLW link

Fake Deeply

Zack_M_Davis26 Oct 2023 19:55 UTC
33 points
7 comments1 min readLW link
(unremediatedgender.space)

Sym­bol/​Refer­ent Con­fu­sions in Lan­guage Model Align­ment Experiments

johnswentworth26 Oct 2023 19:49 UTC
93 points
44 comments6 min readLW link

Un­su­per­vised Meth­ods for Con­cept Dis­cov­ery in AlphaZero

aogara26 Oct 2023 19:05 UTC
9 points
0 comments1 min readLW link
(arxiv.org)

[Question] Non­lin­ear limi­ta­tions of ReLUs

magfrump26 Oct 2023 18:51 UTC
13 points
1 comment1 min readLW link

AI Align­ment Prob­lem: Re­quire­ment not op­tional (A Crit­i­cal Anal­y­sis through Mass Effect Tril­ogy)

TAWSIF AHMED26 Oct 2023 18:02 UTC
−9 points
0 comments4 min readLW link

[Thought Ex­per­i­ment] To­mor­row’s Echo—The fu­ture of syn­thetic com­pan­ion­ship.

Vimal Naran26 Oct 2023 17:54 UTC
−7 points
2 comments2 min readLW link

Disagree­ments over the pri­ori­ti­za­tion of ex­is­ten­tial risk from AI

Olivier Coutu26 Oct 2023 17:54 UTC
10 points
0 comments6 min readLW link

[Question] What if AGI had its own uni­verse to maybe wreck?

mseale26 Oct 2023 17:49 UTC
−1 points
2 comments1 min readLW link

Chang­ing Con­tra Dialects

jefftk26 Oct 2023 17:30 UTC
25 points
2 comments1 min readLW link
(www.jefftk.com)

5 psy­cholog­i­cal rea­sons for dis­miss­ing x-risks from AGI

Igor Ivanov26 Oct 2023 17:21 UTC
24 points
6 comments4 min readLW link

5. Risks from pre­vent­ing le­gi­t­i­mate value change (value col­lapse)

Nora_Ammann26 Oct 2023 14:38 UTC
13 points
1 comment9 min readLW link

4. Risks from caus­ing ille­gi­t­i­mate value change (perfor­ma­tive pre­dic­tors)

Nora_Ammann26 Oct 2023 14:38 UTC
8 points
3 comments5 min readLW link

3. Premise three & Con­clu­sion: AI sys­tems can af­fect value change tra­jec­to­ries & the Value Change Problem

Nora_Ammann26 Oct 2023 14:38 UTC
28 points
4 comments4 min readLW link

2. Premise two: Some cases of value change are (il)legitimate

Nora_Ammann26 Oct 2023 14:36 UTC
24 points
7 comments6 min readLW link

1. Premise one: Values are malleable

Nora_Ammann26 Oct 2023 14:36 UTC
21 points
1 comment15 min readLW link

0. The Value Change Prob­lem: in­tro­duc­tion, overview and motivations

Nora_Ammann26 Oct 2023 14:36 UTC
32 points
0 comments5 min readLW link

EPUBs of MIRI Blog Archives and se­lected LW Sequences

mesaoptimizer26 Oct 2023 14:17 UTC
43 points
6 comments1 min readLW link
(git.sr.ht)

UK Govern­ment pub­lishes “Fron­tier AI: ca­pa­bil­ities and risks” Dis­cus­sion Paper

A.H.26 Oct 2023 13:55 UTC
5 points
0 comments2 min readLW link
(www.gov.uk)

AI #35: Re­spon­si­ble Scal­ing Policies

Zvi26 Oct 2023 13:30 UTC
66 points
10 comments55 min readLW link
(thezvi.wordpress.com)

RA Bounty: Look­ing for feed­back on screen­play about AI Risk

Writer26 Oct 2023 13:23 UTC
30 points
6 comments1 min readLW link

Sen­sor Ex­po­sure can Com­pro­mise the Hu­man Brain in the 2020s

trevor26 Oct 2023 3:31 UTC
17 points
6 comments10 min readLW link

Notes on “How do we be­come con­fi­dent in the safety of a ma­chine learn­ing sys­tem?”

RohanS26 Oct 2023 3:13 UTC
4 points
0 comments13 min readLW link

Ap­ply to the Con­stel­la­tion Visit­ing Re­searcher Pro­gram and As­tra Fel­low­ship, in Berkeley this Winter

Nate Thomas26 Oct 2023 3:07 UTC
42 points
10 comments1 min readLW link

CHAI in­tern­ship ap­pli­ca­tions are open (due Nov 13)

Erik Jenner26 Oct 2023 0:53 UTC
34 points
0 comments3 min readLW link

Ar­chi­tects of Our Own Demise: We Should Stop Devel­op­ing AI

Roko26 Oct 2023 0:36 UTC
174 points
74 comments3 min readLW link

EA In­fras­truc­ture Fund: June 2023 grant recommendations

Linch26 Oct 2023 0:35 UTC
21 points
0 comments1 min readLW link

Re­spon­si­ble Scal­ing Poli­cies Are Risk Man­age­ment Done Wrong

simeon_c25 Oct 2023 23:46 UTC
114 points
33 comments22 min readLW link
(www.navigatingrisks.ai)