6.892 Lecture 14

foo

6.892 Lecture 14

Review and Overview

Mutual Information

Paul’s Thesis Synopsis

Continuous (Relative) Entropy

Example

Scale and Entropy

Entropy of Real Data

Entropy of Real Data

Entropy of Real Data

Schemes for Estimating Entropy

Most Informative Linear Projection

Return of Principle Components

Non-Gaussian Distributions

Histograms

Formal Histograms

Parzen Windows / Soft Histograms