Tying back to an example in the post: if we’re using ascii encoding, then the string “Mark Xu” takes up 49 bits. It’s quite compressible, but that still leaves more than enough room for 24 bits of evidence to be completely reasonable.
This paper suggests that spoken language is consistently ~39bits/second.
This paper suggests that spoken language is consistently ~39bits/second.
https://advances.sciencemag.org/content/5/9/eaaw2594