| Morning: Image Database Retrieval | ||
| Gatekeeper: Face detection and recognition | ||
| Complex Feature Image Database Retrieval (Tieu) | ||
| Flexible Template Retrieval (Yu) | ||
| Interlude | ||
| Video/Audio Source Separation (Fisher) | ||
| Mathematical Expression Recognition (Matsakis) | ||
| Lunch | ||
| Visit Prof. Brooks lab | ||
| Afternoon: Variable Viewpoint Reality | ||
| Real-time 3D reconstruction of people (Snow) | ||
| Automatic camera calibration (Snow + Lee) | ||
| Tracking of articulate human models (Lee + Winn) | ||
| Modeling of human dynamics (Viola + Fisher) | ||
| Construct a system that will allow each/every user to observe any viewpoint of a sporting event. | ||
| Provide high level commentary/statistics | ||
| Analyze plays | ||
| Build an exciting, fun, high-profile system | |||
| Sports: Soccer, Hockey, Tennis, Basketball | |||
| Drama, Dance, Ballet | |||
| Leverage MIT technology in: | |||
| Vision/Video Analysis | |||
| Tracking, Calibration, Action Recognition | |||
| Image/Video Databases | |||
| Graphics | |||
| Build a system that provides data available nowhere else… | |||
| Record/Study Human movements and actions | |||
| Motion Capture / Motion Generation | |||
| 20-50 cameras in a stadium | ||
| Soon there will be many more | ||
| US HDTV is digital | ||
| Flexible, very high bandwidth digital transmissions | ||
| Future Televisions will be Computers | ||
| Plenty of extra computation available | ||
| 3D Graphics hardware will be integrated | ||
| Economics of sports | ||
| Dollar investments by broadcasters is huge (Billions) | ||
| Computation is getting cheaper | ||
ViewCube:
Reconstructing action &
movement
Projecting Silhouettes to
form
3D Models
Finding an articulate human body
Automatically generated result:
| Key Difficulty: Complex Time Trajectories | ||
| Complex Inter-dependencies | ||
| State of the Art: Hidden Markov Models | ||
| Have a discrete number of states | ||
| Our Approach: Multi-scale statistical models | ||
Human Motion is extremely complex:
Texture Analysis and
Synthesis
can be applied to Movement Data