Source Coding and the Entropy Bound

Shannon's source coding theorem in both directions, and Kraft's inequality — why entropy is the floor no lossless code can beat.0/11 mastered

1 / 11

A binary source has p(1) = 0.9 and a compressor assumes a fair coin. Compute D(p||q) in bits, to 4 decimal places.