RSS

Chi Nguyen

Karma: 940

Working independently on making AI systems reason safely about decision theory and acausal interactions, collaborating with Caspar Oesterheld and Emery Cooper.

I try to check the LessWrong infrequently. If you wanna get in touch, you can use my admonymous link and leave your email address there, so I can reply to you! (If you don’t include some contact details in your message, I can’t reply)

You can also just send me thoughts and questions anonymously!

How others can help me

Be interested in working on/​implementing ideas from research on acausal cooperations! Or connect me with people who might be.

How I can help others

Ask me about acausal stuff!

Or any of my background: Before doing independent research, I worked for the Center on Long-Term Risk on s-risk reduction projects (hiring, community building, and grantmaking.) Previously, I was a guest manager at the EA Infrastructure Fund (2021), did some research for 1 Day Sooner on Human Challenge Trials for Covid vaccines (2020), did the summer research fellowship at FHI writing about IDA (2019), worked a few hours a week for CEA on local groups mentoring for a few months (2018), and helped a little bit with organizing EA Oxford (2018/​19). I studied PPE at Oxford (2018-2021) and psychology in Freiburg (2015-2018.)

I also have things to say about mental health and advice for taking a break from work.

Con­cep­tual rea­son­ing dataset v0.1 available (AI for AI safety/​AI for philos­o­phy)

12 Nov 2025 1:12 UTC
9 points
0 comments3 min readLW link

Chi Nguyen’s Shortform

Chi Nguyen9 Feb 2025 20:41 UTC
1 point
3 comments1 min readLW link

A dataset of ques­tions on de­ci­sion-the­o­retic rea­son­ing in New­comb-like problems

16 Dec 2024 22:42 UTC
50 points
1 comment2 min readLW link
(arxiv.org)

What is malev­olence? On the na­ture, mea­sure­ment, and dis­tri­bu­tion of dark traits

23 Oct 2024 8:41 UTC
93 points
23 comments52 min readLW link

The case for more Align­ment Tar­get Anal­y­sis (ATA)

20 Sep 2024 1:14 UTC
27 points
13 comments17 min readLW link

How to do con­cep­tual re­search: Case study in­ter­view with Cas­par Oesterheld

Chi Nguyen14 May 2024 15:09 UTC
48 points
5 comments9 min readLW link

[Question] (When) Should you work through the night when in­spira­tion strikes you?

Chi Nguyen23 Apr 2024 21:07 UTC
21 points
4 comments1 min readLW link

Slim overview of work one could do to make AI go bet­ter (and a grab-bag of other ca­reer con­sid­er­a­tions)

Chi Nguyen20 Mar 2024 23:17 UTC
9 points
1 comment3 min readLW link

AI things that are per­haps as im­por­tant as hu­man-con­trol­led AI

Chi Nguyen3 Mar 2024 18:07 UTC
55 points
4 comments21 min readLW link

Ev­i­den­tial Co­op­er­a­tion in Large Wor­lds: Po­ten­tial Ob­jec­tions & FAQ

28 Feb 2024 18:58 UTC
46 points
5 comments18 min readLW link

Everett branches, in­ter-light cone trade and other alien mat­ters: Ap­pendix to “An ECL ex­plainer”

24 Feb 2024 23:09 UTC
17 points
0 comments11 min readLW link

Co­op­er­at­ing with aliens and AGIs: An ECL explainer

24 Feb 2024 22:58 UTC
57 points
8 comments20 min readLW link

Com­plex­ity of value but not dis­value im­plies more fo­cus on s-risk. Mo­ral un­cer­tainty and prefer­ence util­i­tar­i­anism also do.

Chi Nguyen23 Feb 2024 6:10 UTC
53 points
18 comments2 min readLW link

List of how peo­ple have be­come more hard-working

Chi Nguyen29 Sep 2023 11:30 UTC
70 points
7 comments3 min readLW link

[Question] What’s your stan­dard for good work perfor­mance?

Chi Nguyen27 Sep 2023 16:58 UTC
30 points
3 comments1 min readLW link

[Question] How have you be­come more hard-work­ing?

Chi Nguyen25 Sep 2023 12:37 UTC
82 points
42 comments1 min readLW link

Prob­a­bly tell your friends when they make big mistakes

Chi Nguyen1 Jun 2023 14:30 UTC
15 points
1 comment7 min readLW link

[in­ac­tive] £2000 bounty—con­tra­cep­tives (and UTI) liter­a­ture review

Chi Nguyen15 Sep 2021 22:37 UTC
70 points
14 comments2 min readLW link

My Un­der­stand­ing of Paul Chris­ti­ano’s Iter­ated Am­plifi­ca­tion AI Safety Re­search Agenda

Chi Nguyen15 Aug 2020 20:02 UTC
120 points
20 comments39 min readLW link

English sum­maries of Ger­man Covid-19 ex­pert podcast

Chi Nguyen8 Apr 2020 20:29 UTC
22 points
0 comments2 min readLW link
(www.notion.so)