RSS

Pre­dic­tive Processing

TagLast edit: 26 Dec 2022 6:13 UTC by Roman Leventov

(From Wikipedia) predictive processing (a.k.a. predictive coding, the Bayesian Brain hypothesis) is a theory of brain function in which the brain is constantly generating and updating a mental model of the environment. The model is used to generate predictions of sensory input that are compared to actual sensory input. This comparison results in prediction errors that are then used to update and revise the mental model.

Active Inference can be seen as a generalisation of predictive processing. While predictive processing only explains the agent’s perception, Active Inference models both perception and action as inference under the same unifying objective: optimisation of the informational quantity called variational free energy.

External Links:
Book Review: Surfing Uncertainty—Introduction to predictive processing by Scott Alexander
Predictive Processing And Perceptual Control by Scott Alexander

Related Pages: Perceptual Control Theory, Neuroscience

Multi-agent pre­dic­tive minds and AI alignment

Jan_Kulveit12 Dec 2018 23:48 UTC
63 points
18 comments10 min readLW link

Pre­dic­tive Cod­ing has been Unified with Backpropagation

lsusr2 Apr 2021 21:42 UTC
175 points
51 comments2 min readLW link

God Help Us, Let’s Try To Un­der­stand Fris­ton On Free Energy

Scott Alexander5 Mar 2018 6:00 UTC
49 points
43 comments14 min readLW link
(slatestarcodex.com)

How uniform is the neo­cor­tex?

zhukeepa4 May 2020 2:16 UTC
79 points
23 comments11 min readLW link1 review

Neu­ral An­neal­ing: Toward a Neu­ral The­ory of Every­thing (cross­post)

Michael Edward Johnson29 Nov 2019 17:31 UTC
86 points
28 comments40 min readLW link3 reviews

Min­i­miza­tion of pre­dic­tion er­ror as a foun­da­tion for hu­man val­ues in AI alignment

Gordon Seidoh Worley9 Oct 2019 18:23 UTC
15 points
42 comments5 min readLW link

[Question] What De­ci­sion The­ory is Im­plied By Pre­dic­tive Pro­cess­ing?

johnswentworth28 Sep 2020 17:20 UTC
56 points
17 comments1 min readLW link

Con­fir­ma­tion Bias in Action

Jacob Falkovich24 Jan 2021 17:38 UTC
37 points
1 comment13 min readLW link

Why Si­mu­la­tor AIs want to be Ac­tive In­fer­ence AIs

10 Apr 2023 18:23 UTC
86 points
8 comments8 min readLW link

Pre­dictable Iden­tities—Mid­point Review

Jacob Falkovich12 Sep 2019 14:39 UTC
18 points
0 comments1 min readLW link

Pre­dic­tive cod­ing and mo­tor control

Steven Byrnes23 Feb 2020 2:04 UTC
22 points
3 comments4 min readLW link

Pre­dic­tive cod­ing & depression

Steven Byrnes3 Jan 2020 2:38 UTC
27 points
9 comments7 min readLW link

Crav­ing, suffer­ing, and pre­dic­tive pro­cess­ing (three char­ac­ter­is­tics se­ries)

Kaj_Sotala15 May 2020 13:21 UTC
84 points
56 comments19 min readLW link

Pre­dic­tive cod­ing = RL + SL + Bayes + MPC

Steven Byrnes10 Dec 2019 11:45 UTC
56 points
8 comments8 min readLW link

Book Re­view: Be­ing You by Anil Seth

Alexander26 Oct 2021 5:44 UTC
34 points
23 comments11 min readLW link

It’s Bayes All The Way Up

Scott Alexander12 Sep 2016 13:35 UTC
32 points
0 comments12 min readLW link

AI al­ign­ment as a trans­la­tion problem

Roman Leventov5 Feb 2024 14:14 UTC
21 points
2 comments3 min readLW link

Refine­ment of Ac­tive In­fer­ence agency ontology

Roman Leventov15 Dec 2023 9:31 UTC
16 points
0 comments5 min readLW link
(arxiv.org)

Roll for Sanity

eapache13 Jul 2020 16:39 UTC
16 points
2 comments4 min readLW link

The Great Annealing

Jacob Falkovich30 Mar 2020 1:08 UTC
79 points
5 comments8 min readLW link

Three char­ac­ter­is­tics: impermanence

Kaj_Sotala5 Jun 2020 7:48 UTC
68 points
4 comments18 min readLW link

Towards an In­ten­tional Re­search Agenda

romeostevensit23 Aug 2019 5:27 UTC
20 points
8 comments3 min readLW link

Seth Ex­plains Consciousness

Jacob Falkovich22 Aug 2023 18:06 UTC
38 points
125 comments14 min readLW link
(putanumonit.com)

Toward A Bayesian The­ory Of Willpower

Scott Alexander26 Mar 2021 2:33 UTC
100 points
27 comments6 min readLW link

Pre­dic­tive Pro­cess­ing, Hetero­sex­u­al­ity and Delu­sions of Grandeur

lsusr17 Dec 2022 7:37 UTC
36 points
12 comments5 min readLW link

Beyond Re­in­force­ment Learn­ing: Pre­dic­tive Pro­cess­ing and Checksums

lsusr15 Feb 2023 7:32 UTC
12 points
14 comments3 min readLW link

Ba­sic Math­e­mat­ics of Pre­dic­tive Coding

Adam Shai29 Sep 2023 14:38 UTC
49 points
6 comments9 min readLW link

Biolog­i­cal Holism: A New Paradigm?

Waddington9 May 2021 22:42 UTC
4 points
9 comments19 min readLW link

Magic of syn­chronous conversation

NicholasKees10 Mar 2024 17:17 UTC
18 points
1 comment3 min readLW link

Top Left Mood

Jacob Falkovich24 Jul 2018 14:35 UTC
17 points
2 comments1 min readLW link
(putanumonit.com)

The Medium Is The Bandage

party girl10 Aug 2022 1:45 UTC
11 points
0 comments10 min readLW link

The Echo Principle

Jonathan Moregård16 Nov 2022 20:09 UTC
4 points
0 comments3 min readLW link
(honestliving.substack.com)

Con­di­tion­ing Pre­dic­tive Models: Outer al­ign­ment via care­ful conditioning

2 Feb 2023 20:28 UTC
72 points
13 comments57 min readLW link

Con­di­tion­ing Pre­dic­tive Models: Large lan­guage mod­els as predictors

2 Feb 2023 20:28 UTC
88 points
4 comments13 min readLW link

“She Wanted It”

sarahconstantin11 Nov 2018 22:00 UTC
117 points
19 comments7 min readLW link
(srconstantin.wordpress.com)

A Sim­ple The­ory Of Consciousness

SherlockHolmes8 Aug 2023 18:05 UTC
2 points
5 comments1 min readLW link
(peterholmes.medium.com)

A re­ply to Byrnes on the Free En­ergy Principle

Roman Leventov3 Mar 2023 13:03 UTC
27 points
16 comments14 min readLW link
No comments.