When I hear the phrase “information theory,” I think of Shannon, not Kolmogorov. Shannon entropy is a bridge between the two concepts of your post, but rather closer to thermodynamic.
When I hear the phrase “information theory,” I think of Shannon, not Kolmogorov. Shannon entropy is a bridge between the two concepts of your post, but rather closer to thermodynamic.