The fact that E[H(P^ n)] H(P) follows from the concavity of the entropy (using Jensen’s inequality), upon noting that E(P^ n) = P.. 3 < = :. E \ - h h s y h k lf oh v $ oz d \ v z r q g h u z k d w olih z r x og e h oln h li \ r x r z q h g d - h h s " ' r \ r x v h f u h wo\ v h h n - h h s 7 k u loov " 7 k h q h q wh u wk h z r u og r i - h h s $ q g h y h u \ r q h h ov h mx v w j h wv oh iw e h k lq g 6 wh s lq wr wk h - 6 h w ..
