Pre­dic­tive Processing

TagLast edit: 26 Dec 2022 6:13 UTC by Roman Leventov

(From Wikipedia) predictive processing (a.k.a. predictive coding, the Bayesian Brain hypothesis) is a theory of brain function in which the brain is constantly generating and updating a mental model of the environment. The model is used to generate predictions of sensory input that are compared to actual sensory input. This comparison results in prediction errors that are then used to update and revise the mental model.

Active Inference can be seen as a generalisation of predictive processing. While predictive processing only explains the agent’s perception, Active Inference models both perception and action as inference under the same unifying objective: optimisation of the informational quantity called variational free energy.

External Links:
Book Review: Surfing Uncertainty—Introduction to predictive processing by Scott Alexander
Predictive Processing And Perceptual Control by Scott Alexander

Related Pages: Perceptual Control Theory, Neuroscience

God Help Us, Let’s Try To Un­der­stand Fris­ton On Free Energy

Scott Alexander5 Mar 2018 6:00 UTC
47 points
43 comments14 min readLW link

Pre­dic­tive Cod­ing has been Unified with Backpropagation

lsusr2 Apr 2021 21:42 UTC
174 points
44 comments2 min readLW link

How uniform is the neo­cor­tex?

zhukeepa4 May 2020 2:16 UTC
79 points
23 comments11 min readLW link1 review

Neu­ral An­neal­ing: Toward a Neu­ral The­ory of Every­thing (cross­post)

Michael Edward Johnson29 Nov 2019 17:31 UTC
83 points
28 comments40 min readLW link3 reviews

Pre­dic­tive cod­ing = RL + SL + Bayes + MPC

Steven Byrnes10 Dec 2019 11:45 UTC
53 points
8 comments8 min readLW link

Pre­dic­tive cod­ing and mo­tor control

Steven Byrnes23 Feb 2020 2:04 UTC
22 points
3 comments4 min readLW link

Pre­dic­tive cod­ing & depression

Steven Byrnes3 Jan 2020 2:38 UTC
25 points
9 comments7 min readLW link

Crav­ing, suffer­ing, and pre­dic­tive pro­cess­ing (three char­ac­ter­is­tics se­ries)

Kaj_Sotala15 May 2020 13:21 UTC
75 points
48 comments19 min readLW link

The Great Annealing

Jacob Falkovich30 Mar 2020 1:08 UTC
78 points
5 comments8 min readLW link

Pre­dictable Iden­tities—Mid­point Review

Jacob Falkovich12 Sep 2019 14:39 UTC
18 points
0 comments1 min readLW link

Min­i­miza­tion of pre­dic­tion er­ror as a foun­da­tion for hu­man val­ues in AI alignment

Gordon Seidoh Worley9 Oct 2019 18:23 UTC
15 points
42 comments5 min readLW link

[Question] What De­ci­sion The­ory is Im­plied By Pre­dic­tive Pro­cess­ing?

johnswentworth28 Sep 2020 17:20 UTC
56 points
17 comments1 min readLW link

Con­fir­ma­tion Bias in Action

Jacob Falkovich24 Jan 2021 17:38 UTC
36 points
1 comment13 min readLW link

It’s Bayes All The Way Up

Scott Alexander12 Sep 2016 13:35 UTC
30 points
0 comments12 min readLW link

Book Re­view: Be­ing You by Anil Seth

Alexander26 Oct 2021 5:44 UTC
32 points
21 comments11 min readLW link

Multi-agent pre­dic­tive minds and AI alignment

Jan_Kulveit12 Dec 2018 23:48 UTC
60 points
18 comments10 min readLW link

“She Wanted It”

sarahconstantin11 Nov 2018 22:00 UTC
108 points
19 comments7 min readLW link

Three char­ac­ter­is­tics: impermanence

Kaj_Sotala5 Jun 2020 7:48 UTC
66 points
3 comments18 min readLW link

Towards an In­ten­tional Re­search Agenda

romeostevensit23 Aug 2019 5:27 UTC
20 points
8 comments3 min readLW link

Roll for Sanity

eapache13 Jul 2020 16:39 UTC
16 points
2 comments4 min readLW link

Toward A Bayesian The­ory Of Willpower

Scott Alexander26 Mar 2021 2:33 UTC
100 points
28 comments6 min readLW link

Pre­dic­tive Pro­cess­ing, Hetero­sex­u­al­ity and Delu­sions of Grandeur

lsusr17 Dec 2022 7:37 UTC
36 points
12 comments5 min readLW link

Beyond Re­in­force­ment Learn­ing: Pre­dic­tive Pro­cess­ing and Checksums

lsusr15 Feb 2023 7:32 UTC
12 points
14 comments3 min readLW link

Biolog­i­cal Holism: A New Paradigm?

Waddington9 May 2021 22:42 UTC
3 points
9 comments19 min readLW link

Top Left Mood

Jacob Falkovich24 Jul 2018 14:35 UTC
17 points
2 comments1 min readLW link

The Medium Is The Bandage

party girl10 Aug 2022 1:45 UTC
11 points
0 comments10 min readLW link

The Echo Principle

JonathanMoregard16 Nov 2022 20:09 UTC
5 points
0 comments3 min readLW link

Con­di­tion­ing Pre­dic­tive Models: Outer al­ign­ment via care­ful conditioning

2 Feb 2023 20:28 UTC
72 points
13 comments53 min readLW link

Con­di­tion­ing Pre­dic­tive Models: Large lan­guage mod­els as predictors

2 Feb 2023 20:28 UTC
82 points
4 comments13 min readLW link

A re­ply to Byrnes on the Free En­ergy Principle

Roman Leventov3 Mar 2023 13:03 UTC
24 points
16 comments14 min readLW link
No comments.