The best book is doubtlessly Elements of Information Theory by Cover and Thomas. It’s very clear (to someone with some background in math or theoretical computer science) and lays very strong introductory foundations before giving a good overview of some of the deeper aspects of the theory.
It’s fortunate that many concepts of information theory share some of their mathematical meaning with the everyday meaning. This way I can explain the new theory (popularized here for the first time) without defining these concepts.
I’m planning another sequence where these and other concepts will be expressed in the philosophical framework of this community. But I should’ve realized that some readers should be interested in a complete mathematical introduction. That book is what you’re looking for.
Thanks!
The best book is doubtlessly Elements of Information Theory by Cover and Thomas. It’s very clear (to someone with some background in math or theoretical computer science) and lays very strong introductory foundations before giving a good overview of some of the deeper aspects of the theory.
It’s fortunate that many concepts of information theory share some of their mathematical meaning with the everyday meaning. This way I can explain the new theory (popularized here for the first time) without defining these concepts.
I’m planning another sequence where these and other concepts will be expressed in the philosophical framework of this community. But I should’ve realized that some readers should be interested in a complete mathematical introduction. That book is what you’re looking for.
Thanks