LessWrong Review

TagLast edit: 19 Jan 2024 0:46 UTC by Ruby

The LessWrong Annual Review is a central mechanism for reviewing the site’s content, it’s kind of like our site’s peer review process.

LessWrong has the goal of making intellectual progress on important problems. To make progress, you gotta examine your community’s outputs not only when they’re first published, but also once enough time has passed to see whether they continued to provide value after initial hype fades and flaws have had time to surface.

So far, the bulk of the LessWrong Review happens in the winter season, over December and January. Batched yearly, we review the posts from the previous year. 2019′s post get reviewed at the end of 2020 (i.e. every post in each review batch is 1-2 years old).

For two months, the community nominates, writes reviews, and votes on the most valuable posts. Reviewers ask questions like:

The community answering these questions leads to benefits like:

You can see the top posts from previous years on the Best of LessWrong page. You can see the individual results page for each Annual Review so far: 2018, 2019, 2020, 2021.

What is the Review process?

[New!] The LessWrong team is currently experimenting with ways to give the Annual Review year-long salience, i.e. by giving people the ability to bet in prediction markets about which posts will be rated highly in the Review, and by giving Review “winners” prominent treatment (e.g. cool art on their post pages).

For the last few years, the Annual Review has followed the same three-stage template:
1. A couple of weeks of nominating posts for consideration in the review.
2. A month of writing reviews and critiques of posts.
3. Two final weeks voting on which posts were ultimately most valuable.

The exact process of the Annual Review is not locked in stone and the LessWrong team might decide to change it dramatically in the future. That said, for the past five years it has followed approximately the same basic format:

  1. Preliminary Voting Phase (2 weeks): We identify posts especially worthy of consideration in the review casting preliminary votes. Posts with 2 preliminary votes move into the Discussion Phase.

  2. Discussion Phase (4 weeks): We review and debate posts. Posts that receive at least one written review move to the final voting phase.

  3. Final Voting (2 weeks): We do a full voting pass, using quadratic voting. The outcome determines the Annual Review results.

The LessWrong 2018 Review

Raemon21 Nov 2019 2:50 UTC
101 points
91 comments7 min readLW link

Book Launch: The Eng­ines of Cognition

Ben Pace21 Dec 2021 7:24 UTC
174 points
55 comments5 min readLW link

2019 Re­view: Vot­ing Re­sults!

1 Feb 2021 3:10 UTC
99 points
36 comments7 min readLW link

The 2020 Review

Raemon2 Dec 2021 0:39 UTC
112 points
39 comments6 min readLW link

The LessWrong 2021 Re­view: In­tel­lec­tual Cir­cle Expansion

1 Dec 2022 21:17 UTC
95 points
55 comments8 min readLW link

2018 Re­view: Vot­ing Re­sults!

Ben Pace24 Jan 2020 2:00 UTC
135 points
59 comments6 min readLW link

2020 Re­view Article

Vaniver14 Jan 2022 4:58 UTC
74 points
3 comments7 min readLW link

The LessWrong 2018 Book is Available for Pre-order

1 Dec 2020 8:00 UTC
187 points
110 comments10 min readLW link

The LessWrong 2022 Review

habryka5 Dec 2023 4:00 UTC
114 points
43 comments4 min readLW link

Re­view­ing the Review

Raemon26 Feb 2020 2:51 UTC
45 points
16 comments9 min readLW link

The 2021 Re­view Phase

Raemon5 Jan 2023 7:12 UTC
34 points
7 comments3 min readLW link

The LessWrong 2019 Review

habryka2 Dec 2020 11:21 UTC
113 points
47 comments9 min readLW link

Vot­ing Re­sults for the 2020 Review

Raemon2 Feb 2022 18:37 UTC
108 points
17 comments59 min readLW link

Prizes for the 2021 Review

Raemon10 Feb 2023 19:47 UTC
69 points
2 comments4 min readLW link

Re­view of Soft Take­off Can Still Lead to DSA

Daniel Kokotajlo10 Jan 2021 18:10 UTC
76 points
15 comments6 min readLW link

Vot­ing Phase for 2019 Review

Raemon13 Jan 2021 1:33 UTC
53 points
18 comments3 min readLW link

2020 Re­view: The Dis­cus­sion Phase

Vaniver15 Dec 2021 1:12 UTC
55 points
14 comments2 min readLW link

High­lights and Prizes from the 2021 Re­view Phase

Raemon23 Jan 2023 21:41 UTC
38 points
14 comments21 min readLW link

[Question] Con­fu­sion about Se­quences and Re­view Sequences

Alex_Altair21 Dec 2021 18:13 UTC
14 points
3 comments1 min readLW link

Prizes for last year’s 2019 Review

Raemon20 Dec 2021 21:58 UTC
40 points
0 comments3 min readLW link

Ben Pace’s Con­tro­ver­sial Picks for the 2020 Review

Ben Pace27 Dec 2021 18:25 UTC
62 points
8 comments8 min readLW link

Vot­ing Re­sults for the 2021 Review

Raemon1 Feb 2023 8:02 UTC
66 points
10 comments38 min readLW link

Do you want quadratic vot­ing in the Fi­nal Vot­ing Phase?

Raemon13 Jan 2022 20:20 UTC
22 points
2 comments1 min readLW link

Im­pli­ca­tions of Civ­i­liza­tional Inad­e­quacy (re­view­ing mazes/​simu­lacra/​etc)

Raemon21 Jan 2022 1:45 UTC
93 points
13 comments10 min readLW link

2022 (and All Time) Posts by Ping­back Count

Raemon16 Dec 2023 21:17 UTC
51 points
14 comments6 min readLW link

Book Launch: “The Carv­ing of Real­ity,” Best of LessWrong vol. III

Raemon16 Aug 2023 23:52 UTC
131 points
22 comments5 min readLW link

Week­end Re­view Bash: Guided re­view writ­ing, Fore­cast­ing and co-work­ing, in EU and US times

jacobjacob8 Jan 2021 21:04 UTC
17 points
1 comment1 min readLW link

Vote in the LessWrong re­view! (LW 2022 Re­view vot­ing phase)

habryka17 Jan 2024 7:22 UTC
26 points
9 comments2 min readLW link

The LessWrong 2022 Re­view: Re­view Phase

RobertM22 Dec 2023 3:23 UTC
58 points
7 comments2 min readLW link

Re­view AI Align­ment posts to help figure out how to make a proper AI Align­ment review

10 Jan 2023 0:19 UTC
84 points
31 comments2 min readLW link

Cre­dence polls for 26 claims from the 2019 Review

jacobjacob9 Jan 2021 7:13 UTC
54 points
2 comments1 min readLW link

Prizes for Last Year’s 2018 Review

Raemon2 Dec 2020 11:21 UTC
72 points
8 comments1 min readLW link

2020 Re­view: Fi­nal Voting

Raemon28 Jan 2022 3:39 UTC
34 points
8 comments2 min readLW link

[Question] LessWrong Is Very Wrong: Ul­ti­mately All So­cial Me­dia Plat­forms Are The Same

Amritesh Kumar13 Feb 2024 6:53 UTC
−16 points
2 comments1 min readLW link

Prizes for the 2020 Review

Raemon20 Feb 2022 21:07 UTC
94 points
1 comment6 min readLW link

The Re­view Phase

Ben Pace9 Dec 2019 0:54 UTC
53 points
3 comments5 min readLW link

Thun­der­dome and Re­view Co-Vot­ing (Meetup Sun­day 12pm PT)

Raemon14 Jan 2021 23:04 UTC
21 points
3 comments1 min readLW link

10 posts I like in the 2018 Review

Ben Pace11 Jan 2020 2:23 UTC
31 points
0 comments2 min readLW link

LW Team Up­dates—De­cem­ber 2019

Ruby5 Dec 2019 20:40 UTC
40 points
7 comments3 min readLW link

Vot­ing Phase of 2018 LW Re­view

Ben Pace8 Jan 2020 3:35 UTC
51 points
29 comments4 min readLW link

Please Cri­tique Things for the Re­view!

Raemon11 Jan 2020 20:59 UTC
48 points
30 comments1 min readLW link

Vot­ing Phase UI: Ag­gre­gat­ing com­mon com­ments?

Raemon31 Dec 2019 3:48 UTC
9 points
5 comments1 min readLW link

Thread for mak­ing 2019 Re­view ac­countabil­ity commitments

jacobjacob18 Dec 2020 5:07 UTC
46 points
6 comments2 min readLW link

Re­view Vot­ing Thread

Ben Pace30 Dec 2020 3:23 UTC
35 points
132 comments1 min readLW link

2019 Re­view Cowork­ing Party [Wed 7pm PT]

Raemon5 Jan 2021 23:22 UTC
34 points
9 comments1 min readLW link

Re­view of ‘But ex­actly how com­plex and frag­ile?’

TurnTrout6 Jan 2021 18:39 UTC
56 points
0 comments8 min readLW link

Re­view of ‘De­bate on In­stru­men­tal Con­ver­gence be­tween LeCun, Rus­sell, Ben­gio, Zador, and More’

TurnTrout12 Jan 2021 3:57 UTC
40 points
1 comment2 min readLW link

Episte­mol­ogy Vol­ume of “A Map That Reflects the Ter­ri­tory” Set—My Per­sonal Commentary

hamnox24 Dec 2020 21:34 UTC
20 points
1 comment8 min readLW link

Quadratic vot­ing for the 2018 Review

Ben Pace20 Dec 2019 22:59 UTC
39 points
42 comments5 min readLW link

Re­views as “How should this be im­proved to meet the bar?”

Raemon28 Dec 2020 2:55 UTC
26 points
1 comment1 min readLW link

2019 Re­view Rewrite: Seek­ing Power is Often Ro­bustly In­stru­men­tal in MDPs

TurnTrout23 Dec 2020 17:16 UTC
35 points
0 comments4 min readLW link

Re­view: LessWrong Best of 2018 – Epistemology

Jacob Falkovich28 Dec 2020 4:32 UTC
47 points
15 comments7 min readLW link
No comments.