Mdoan answers Where can one learn deep intuitions about information theory?

[Mdoan]

The Information by James Gleick is an interesting book on information theory.