In­for­ma­tion Theory

En­tropy, and Short Codes

Con­di­tional In­de­pen­dence, and Naive Bayes

Mes­sage Length

Utility Max­i­miza­tion = De­scrip­tion Length Minimization

Msg Len

Gen­er­al­ized Heat Engine

In­for­ma­tion the­ory and the sym­me­try of up­dat­ing beliefs

The Se­cond Law of Ther­mo­dy­nam­ics, and Eng­ines of Cognition

Search­ing for Bayes-Structure

Mu­tual In­for­ma­tion, and Den­sity in Thingspace

Spec­u­la­tions on in­for­ma­tion un­der log­i­cal uncertainty

Com­bin­ing causal­ity with al­gorith­mic in­for­ma­tion theory

How to Throw Away Information

Law with­out law: from ob­server states to physics via al­gorith­mic in­for­ma­tion theory

A quick sketch on how the Curry-Howard Iso­mor­phism kinda ap­pears to con­nect Al­gorith­mic In­for­ma­tion The­ory with or­di­nal logics

An Un­der­grad­u­ate Read­ing Of: Se­man­tic in­for­ma­tion, au­tonomous agency and non-equil­ibrium statis­ti­cal physics

[LINK] The Bayesian Se­cond Law of Thermodynamics

My (Mis)Ad­ven­tures With Al­gorith­mic Ma­chine Learning

Blind artifacts

KL Diver­gence as Code Patch­ing Efficiency

A Toy Model for Me­dia Sharing

Min­i­mal Maps, Semi-De­ci­sions, and Neu­ral Representations

[Question] Are the Born prob­a­bil­ities re­ally that mys­te­ri­ous?