RSS

In­for­ma­tion Theory

Tag

En­tropy, and Short Codes

Eliezer Yudkowsky23 Feb 2008 3:16 UTC
63 points
27 comments4 min readLW link

Con­di­tional In­de­pen­dence, and Naive Bayes

Eliezer Yudkowsky1 Mar 2008 1:59 UTC
52 points
16 comments6 min readLW link

Mes­sage Length

Zack_M_Davis20 Oct 2020 5:52 UTC
128 points
25 comments12 min readLW link

The Tele­phone The­o­rem: In­for­ma­tion At A Dis­tance Is Me­di­ated By Deter­minis­tic Constraints

johnswentworth31 Aug 2021 16:50 UTC
79 points
16 comments9 min readLW link

[Question] Where can one learn deep in­tu­itions about in­for­ma­tion the­ory?

Valentine16 Dec 2021 15:47 UTC
71 points
25 comments2 min readLW link

Utility Max­i­miza­tion = De­scrip­tion Length Minimization

johnswentworth18 Feb 2021 18:04 UTC
166 points
38 comments5 min readLW link

The Se­cond Law of Ther­mo­dy­nam­ics, and Eng­ines of Cognition

Eliezer Yudkowsky27 Feb 2008 0:48 UTC
125 points
71 comments9 min readLW link

Msg Len

Zack_M_Davis12 Oct 2020 3:35 UTC
59 points
4 comments1 min readLW link

Gen­er­al­ized Heat Engine

johnswentworth5 Nov 2020 19:01 UTC
145 points
12 comments7 min readLW link

In­for­ma­tion Assets

ozziegooen24 Aug 2021 4:32 UTC
35 points
2 comments9 min readLW link

Un­der­stand­ing the Merg­ing of Opinions with In­creas­ing In­for­ma­tion theorem

ViktoriaMalyasova21 Apr 2022 14:13 UTC
13 points
1 comment5 min readLW link

In­for­ma­tion the­ory and the sym­me­try of up­dat­ing beliefs

Academian20 Mar 2010 0:34 UTC
63 points
29 comments8 min readLW link

Search­ing for Bayes-Structure

Eliezer Yudkowsky28 Feb 2008 22:01 UTC
58 points
48 comments5 min readLW link

Mu­tual In­for­ma­tion, and Den­sity in Thingspace

Eliezer Yudkowsky23 Feb 2008 19:14 UTC
40 points
28 comments7 min readLW link

Spec­u­la­tions on in­for­ma­tion un­der log­i­cal uncertainty

TsviBT24 Feb 2016 21:58 UTC
1 point
0 comments12 min readLW link

Com­bin­ing causal­ity with al­gorith­mic in­for­ma­tion theory

[deleted]9 Jun 2012 1:31 UTC
21 points
3 comments1 min readLW link

How to Throw Away Information

johnswentworth5 Sep 2019 21:10 UTC
18 points
5 comments5 min readLW link

Law with­out law: from ob­server states to physics via al­gorith­mic in­for­ma­tion theory

avturchin28 Sep 2018 10:07 UTC
14 points
6 comments2 min readLW link
(arxiv.org)

A quick sketch on how the Curry-Howard Iso­mor­phism kinda ap­pears to con­nect Al­gorith­mic In­for­ma­tion The­ory with or­di­nal logics

[deleted]19 Apr 2015 19:35 UTC
26 points
27 comments3 min readLW link

An Un­der­grad­u­ate Read­ing Of: Se­man­tic in­for­ma­tion, au­tonomous agency and non-equil­ibrium statis­ti­cal physics

ryan_b30 Oct 2018 18:36 UTC
28 points
2 comments5 min readLW link

[LINK] The Bayesian Se­cond Law of Thermodynamics

shminux12 Aug 2015 16:52 UTC
13 points
16 comments1 min readLW link

My (Mis)Ad­ven­tures With Al­gorith­mic Ma­chine Learning

AHartNtkn20 Sep 2020 5:31 UTC
16 points
4 comments41 min readLW link

Blind artifacts

So8res7 Apr 2015 23:23 UTC
36 points
2 comments2 min readLW link

KL Diver­gence as Code Patch­ing Efficiency

Zachary Robertson27 Sep 2020 16:06 UTC
17 points
0 comments8 min readLW link

A Toy Model for Me­dia Sharing

Zachary Robertson17 Oct 2020 15:59 UTC
12 points
0 comments3 min readLW link

Min­i­mal Maps, Semi-De­ci­sions, and Neu­ral Representations

Zachary Robertson6 Dec 2020 15:15 UTC
30 points
2 comments4 min readLW link

[Question] Are the Born prob­a­bil­ities re­ally that mys­te­ri­ous?

Adele Lopez2 Mar 2021 3:08 UTC
44 points
14 comments1 min readLW link

Our com­pressed perception

pchvykov6 Apr 2021 11:01 UTC
11 points
0 comments2 min readLW link

Mind­ful­ness as debugging

pchvykov30 Apr 2021 16:59 UTC
19 points
4 comments2 min readLW link

Does but­terfly af­fect?

pchvykov14 May 2021 4:20 UTC
14 points
22 comments2 min readLW link

The Black­well or­der as a for­mal­iza­tion of knowledge

Alex Flint10 Sep 2021 2:51 UTC
38 points
9 comments11 min readLW link

En­tropy isn’t suffi­cient to mea­sure pass­word strength

benwr17 Jan 2022 6:41 UTC
36 points
32 comments2 min readLW link
(www.benwr.net)

De­con­fus­ing Lan­dauer’s Principle

euanmclean27 May 2022 17:58 UTC
44 points
12 comments15 min readLW link

A physi­cist’s ap­proach to Ori­gins of Life

pchvykov28 Jun 2022 15:23 UTC
6 points
0 comments16 min readLW link

What Is The True Name of Mo­du­lar­ity?

1 Jul 2022 14:55 UTC
12 points
2 comments12 min readLW link
No comments.