RSS

Co­or­di­na­tion /​ Cooperation

Co­or­di­na­tion is the challenge of dis­tinct ac­tors be­ing able to jointly choose their ac­tions to achieve a fa­vor­able out­come. An ex­am­ple of easy co­or­di­na­tion is co­or­di­nat­ing to drive on the same side of the road. A hard ex­am­ple is co­or­di­nat­ing ev­ery­one to move a su­pe­rior yet differ­ent so­cial me­dia plat­form. Many failures of civ­i­liza­tion are failures of co­or­di­na­tion. A closely re­lated con­cept is that of co­op­er­a­tion – mul­ti­ple ac­tors choos­ing their ac­tions in ways that max­i­mize col­lec­tive value de­spite the temp­ta­tion of greater short-term in­di­vi­d­ual gain by act­ing to the detri­ment of the group/​other ac­tors. The Pri­soner’s Dilemma is the canon­i­cal co­op­er­a­tion/​defec­tion game, but the term is used in other games too, e.g. Stag Hunt.

Co­or­di­na­tion and co­op­er­a­tion are fun­da­men­tal con­cepts in Game The­ory. LessWrong dis­cus­sion has long been in­ter­ested in over­com­ing the gnarly co­or­di­na­tion and co­op­er­a­tion challenges that pre­vent many im­prove­ments to op­ti­miz­ing the world. There is also in­ter­est be­cause failures to co­or­di­nate/​co­op­er­ate are likely causes of ex­is­ten­tial risks such as AI Risk or nu­clear war.

See also: Game The­ory, Moloch

Another re­lated term in this space is col­lec­tive ac­tion prob­lem.

Re­lated Se­quences: Kick­starter for Co­or­di­nated Action

Co­or­di­na­tion as a Scarce Resource

johnswentworth
25 Jan 2020 23:32 UTC
112 points
10 comments4 min readLW link

Two Co­or­di­na­tion Styles

abramdemski
7 Feb 2018 9:00 UTC
84 points
14 comments7 min readLW link

The Costly Co­or­di­na­tion Mechanism of Com­mon Knowledge

Ben Pace
15 Mar 2018 20:20 UTC
219 points
30 comments19 min readLW link4 nominations2 reviews

Co­or­di­na­tion Sur­veys: why we should sur­vey to or­ga­nize re­spon­si­bil­ities, not just predictions

Academian
7 May 2019 17:43 UTC
69 points
6 comments3 min readLW link

A Key Power of the Pres­i­dent is to Co­or­di­nate the Ex­e­cu­tion of Ex­ist­ing Con­crete Plans

Ben Pace
16 Jul 2019 5:06 UTC
126 points
13 comments10 min readLW link

Most Pri­soner’s Dilem­mas are Stag Hunts; Most Stag Hunts are Bat­tle of the Sexes

abramdemski
14 Sep 2020 22:13 UTC
101 points
18 comments9 min readLW link

[Question] Does it be­come eas­ier, or harder, for the world to co­or­di­nate around not build­ing AGI as time goes on?

elityre
29 Jul 2019 22:59 UTC
85 points
27 comments3 min readLW link

Why Our Kind Can’t Cooperate

Eliezer Yudkowsky
20 Mar 2009 8:37 UTC
173 points
201 comments9 min readLW link

Tac­ti­cal vs. Strate­gic Cooperation

sarahconstantin
12 Aug 2018 16:41 UTC
76 points
18 comments5 min readLW link

Ro­bust Co­op­er­a­tion in the Pri­soner’s Dilemma

orthonormal
7 Jun 2013 8:30 UTC
73 points
146 comments7 min readLW link

Black­mail, Nukes and the Pri­soner’s Dilemma

Stuart_Armstrong
10 Mar 2010 14:58 UTC
20 points
20 comments2 min readLW link

What counts as defec­tion?

TurnTrout
12 Jul 2020 22:03 UTC
84 points
20 comments4 min readLW link

Sec­tions 1 & 2: In­tro­duc­tion, Strat­egy and Governance

JesseClifton
17 Dec 2019 21:27 UTC
35 points
5 comments14 min readLW link

Sec­tions 3 & 4: Cred­i­bil­ity, Peace­ful Bar­gain­ing Mechanisms

JesseClifton
17 Dec 2019 21:46 UTC
21 points
2 comments12 min readLW link

“You can’t pos­si­bly suc­ceed with­out [My Pet Is­sue]”

Raemon
19 Dec 2019 1:12 UTC
53 points
14 comments1 min readLW link

Shap­ing eco­nomic in­cen­tives for col­lab­o­ra­tive AGI

Kaj_Sotala
29 Jun 2018 16:26 UTC
47 points
15 comments4 min readLW link

Mul­ti­verse-wide Co­op­er­a­tion via Cor­re­lated De­ci­sion Making

Kaj_Sotala
20 Aug 2017 12:01 UTC
4 points
2 comments1 min readLW link
(foundational-research.org)

From Per­sonal to Pri­son Gangs: En­forc­ing Proso­cial Behavior

johnswentworth
24 Jan 2019 18:07 UTC
88 points
9 comments5 min readLW link

In­sights from ‘The Strat­egy of Con­flict’

DanielFilan
4 Jan 2018 5:05 UTC
73 points
13 comments7 min readLW link

Win­ning is for Losers

Jacobian
11 Oct 2017 4:01 UTC
72 points
12 comments18 min readLW link
(putanumonit.com)

Bayesi­ans vs. Barbarians

Eliezer Yudkowsky
14 Apr 2009 23:45 UTC
64 points
283 comments8 min readLW link

Co­op­er­at­ing with agents with differ­ent ideas of fair­ness, while re­sist­ing exploitation

Eliezer Yudkowsky
16 Sep 2013 8:27 UTC
48 points
45 comments4 min readLW link

The Im­por­tance of Sidekicks

Swimmer963
8 Jan 2015 23:21 UTC
149 points
209 comments5 min readLW link

Team Co­he­sion and Ex­clu­sion­ary Egalitarianism

lionhearted
17 Sep 2018 4:48 UTC
36 points
6 comments7 min readLW link

Healthy Competition

Raemon
20 Oct 2019 20:55 UTC
57 points
8 comments2 min readLW link

Reneg­ing proso­cially by Dun­can Sabien

crabman
18 Jun 2019 18:52 UTC
59 points
4 comments1 min readLW link
(medium.com)

[Question] How could “Kick­starter for Inad­e­quate Equil­ibria” be used for evil or turn out to be net-nega­tive?

Raemon
21 Feb 2019 21:36 UTC
25 points
17 comments1 min readLW link

Schel­ling Reach

Ziz
7 Jan 2018 18:18 UTC
32 points
3 comments1 min readLW link
(sinceriously.fyi)

Real-World Co­or­di­na­tion Prob­lems are Usu­ally In­for­ma­tion Problems

johnswentworth
13 Jun 2019 18:21 UTC
29 points
2 comments4 min readLW link

Vanilla and choco­late and prefer­ence judgements

Swimmer963
18 Apr 2011 22:14 UTC
29 points
32 comments6 min readLW link

The Align­ment-Com­pe­tence Trade-Off, Part 1: Coal­i­tion Size and Sig­nal­ing Costs

Gentzel
15 Jan 2020 23:10 UTC
31 points
4 comments3 min readLW link
(theconsequentialist.wordpress.com)

Inad­e­quate Equil­ibria vs. Gover­nance of the Commons

Martin Sustrik
25 May 2018 13:17 UTC
190 points
19 comments14 min readLW link2 nominations3 reviews

Melt­ing Gold, and Or­ga­ni­za­tional Capacity

Raemon
11 Dec 2017 19:16 UTC
125 points
22 comments5 min readLW link

Ideas for an ac­tion co­or­di­na­tion website

Yoav Ravid
8 Mar 2019 13:32 UTC
18 points
36 comments5 min readLW link

Norms of Mem­ber­ship for Vol­un­tary Groups

sarahconstantin
11 Dec 2018 22:10 UTC
193 points
8 comments7 min readLW link
(srconstantin.wordpress.com)

What is op­er­a­tions?

Swimmer963
26 Sep 2019 14:16 UTC
100 points
6 comments7 min readLW link

Defect­ing by Ac­ci­dent—A Flaw Com­mon to An­a­lyt­i­cal People

lionhearted
1 Dec 2010 8:25 UTC
105 points
431 comments15 min readLW link

Les­sons from the Cold War on In­for­ma­tion Hazards: Why In­ter­nal Com­mu­ni­ca­tion is Critical

Gentzel
24 Feb 2018 23:34 UTC
82 points
10 comments4 min readLW link2 nominations

Tol­er­ate Tolerance

Eliezer Yudkowsky
21 Mar 2009 7:34 UTC
81 points
92 comments2 min readLW link

Lead­ers of Men

Zvi
29 Oct 2017 18:10 UTC
88 points
16 comments2 min readLW link
(thezvi.wordpress.com)

The Dar­win Results

Zvi
25 Nov 2017 13:30 UTC
76 points
10 comments5 min readLW link
(thezvi.wordpress.com)

I Want To Live In A Baugruppe

Alicorn
17 Mar 2017 1:36 UTC
64 points
193 comments3 min readLW link

The Dar­win Pregame

Zvi
21 Nov 2017 1:10 UTC
59 points
6 comments5 min readLW link
(thezvi.wordpress.com)

Buri­dan’s ass in co­or­di­na­tion games

jessicata
16 Jul 2018 2:51 UTC
55 points
26 comments10 min readLW link

Your Price for Joining

Eliezer Yudkowsky
26 Mar 2009 7:16 UTC
61 points
58 comments4 min readLW link

Re­duc­ing col­lec­tive ra­tio­nal­ity to in­di­vi­d­ual op­ti­miza­tion in com­mon-pay­off games us­ing MCMC

jessicata
20 Aug 2018 0:51 UTC
58 points
12 comments7 min readLW link

Coun­ter­fac­tu­als about So­cial Media

Zvi
22 Apr 2019 12:20 UTC
55 points
23 comments6 min readLW link
(thezvi.wordpress.com)

Some Ways Co­or­di­na­tion is Hard

Zvi
13 Jun 2019 13:00 UTC
46 points
7 comments10 min readLW link
(thezvi.wordpress.com)

Can you elimi­nate memetic scarcity, in­stead of fight­ing?

Raemon
25 Nov 2019 2:07 UTC
66 points
11 comments4 min readLW link

[Question] If a “Kick­starter for Inad­e­quate Equlibria” was built, do you have a con­crete in­ad­e­quate equil­ibrium to fix?

Raemon
21 Feb 2019 21:32 UTC
53 points
34 comments1 min readLW link

So­phie Grouchy on A Build-Break Model of Cooperation

weft
25 May 2018 14:55 UTC
57 points
6 comments8 min readLW link
(sophiegrouchy.wordpress.com)

Prop­erty as Co­or­di­na­tion Minimization

Vaniver
4 Aug 2020 19:24 UTC
39 points
35 comments4 min readLW link

Let’s split the cake, length­wise, up­wise and slantwise

Stuart_Armstrong
25 Oct 2010 13:15 UTC
52 points
29 comments4 min readLW link

[Question] Where are peo­ple think­ing and talk­ing about global co­or­di­na­tion for AI safety?

Wei_Dai
22 May 2019 6:24 UTC
100 points
22 comments1 min readLW link

How hard is it for al­tru­ists to dis­cuss go­ing against bad equil­ibria?

abramdemski
22 Jun 2019 3:42 UTC
52 points
3 comments11 min readLW link

AI co­op­er­a­tion is already stud­ied in academia as “pro­gram equil­ibrium”

cousin_it
30 Jul 2012 15:22 UTC
36 points
44 comments1 min readLW link

Tomb­stone Men­tal­ity

SuperDaveWhite
13 Aug 2020 13:46 UTC
4 points
0 comments2 min readLW link

Self-Similar­ity Experiment

Telofy
15 Aug 2020 13:19 UTC
11 points
0 comments10 min readLW link

Alle­gory On AI Risk, Game The­ory, and Mithril

James_Miller
13 Feb 2017 20:41 UTC
25 points
57 comments3 min readLW link

One Web­site To Rule Them All?

anna_macdonald
11 Jan 2019 19:14 UTC
32 points
23 comments10 min readLW link

Col­lec­tive Apa­thy and the Internet

Eliezer Yudkowsky
14 Apr 2009 0:02 UTC
33 points
34 comments2 min readLW link

Break­ing Or­a­cles: su­per­ra­tional­ity and acausal trade

Stuart_Armstrong
25 Nov 2019 10:40 UTC
25 points
15 comments1 min readLW link

[Question] De­gree of du­pli­ca­tion and co­or­di­na­tion in pro­jects that ex­am­ine com­put­ing prices, AI progress, and re­lated top­ics?

riceissa
23 Apr 2019 12:27 UTC
28 points
1 comment2 min readLW link

Su­per­in­tel­li­gence 28: Collaboration

KatjaGrace
24 Mar 2015 1:29 UTC
7 points
21 comments6 min readLW link