Introduction to Computational Mechanics

What is the computational nature of systems? For systems that are engineered by humans, Theory of Computation provides a formal framework for understanding the nature of a computing device, but it doesn’t seem to apply well to systems that arise from more natural learning algorithms, like via evolution or even backpropagation.

Computational Mechanics is an extension of Information Theory and Theory of Computation that is geared towards formalizing the computational nature of more natural systems. In this series we will go through the formalism, while also emphasizing the many conceptual and sometimes philosophical points found therein.

Beyond Kol­mogorov and Shannon

En­tropy Scal­ing And In­trin­sic Me­mory

Pon­der­ing com­pu­ta­tion in the real world