𝑛 outcomes from a source 𝑋 can be compressed into roughly 𝑛·𝐻(𝑋) bits

where:

  • 𝐻(𝑋) - is entropy of 𝑋