Shannon entropy
Some examples of what the formula produces:
Fair coin is 2 (sides) x .5 (probability) x log(2) = 1 x .3010 = .3
Fair hundred sided die 100 x .01 x log(100) = 1 x 2 = 2
Some examples of what the formula produces:
Fair coin is 2 (sides) x .5 (probability) x log(2) = 1 x .3010 = .3
Fair hundred sided die 100 x .01 x log(100) = 1 x 2 = 2