This theorem provides another justification for the definition of entropyrate

This theorem provides another justification for the definition of entropy
rate—it is the expected number of bits per symbol required to describe
the process