6.892 Lecture 13

foo

6.892 Lecture 13

Review and Overview

Statistics of Random Variables

How can we measure Randomness?

Likelihood Measures Randomness

Discrete Entropy Facts

Entropy and Code Length

Conditional Entropy