Schemes for Estimating Entropy

Schemes for Estimating Entropy

• Given Samples not Distributions
• Assume some form for the distributions
  • Gaussian
  • Uniform
  • Mixture of Gaussian
• Fit the distribution to the data
  • Maximum Likelihood
• Compute the entropy of the distribution

Previous slide

Next slide

Back to the first slide

View Graphic Version

Maximum likelihood uniform distribution....