6.892 Lecture 16

Review and Overview

Tony Bell

Brain Cells

Review Linear Info Max

Components of Mutual Info

Transformation of Densities

Transformation of Entropy

Example

Analysis of Linsker

What about Non-linear Info Max?

PP Presentation

The Derivative of Entropy

The Update Rule

Information Theory for Signal Separation

Mathematical Assumptions

The Unmixing Problem

A Particular Approach

What is the Right F()?

The Correct F() is....