Model-Based Face Analysis

Model-Based Face AnalysisSimon Baker, Research Scientist
Robotics Institute, Carnegie Mellon University, Pittsburgh, PA1:00- 2:30 pm
November 30, 2005
OHE Studio CAbstract:A face model is a mapping from a set of parameters to an image of a face. The most well-known face models are Active Appearance Models and 3D Morphable Models. Computer vision applications of face models include head pose estimation for user interfaces, gaze estimation, pose normalization for face recognition, lip-reading, expression recognition, and face coding for low bandwidth video-conferencing. In all of these applications, the key task is to fit the face model to an input image; i.e. to find the parameters of the model that match the input image as well as possible.In this talk I will describe how face model fitting, a non-linear optimization, can be posed as an image alignment problem. Image alignment is a standard computer vision technique, with applications to optical flow, tracking, mosaic construction, layered scene representations, and medical image registration. I will describe an efficient image alignment algorithm and show how it relates to others in a unifying framework. Applying our algorithm to faces results in real time 2D, 3D, and multi-view face model fitting algorithms.
Bio:
Simon Baker is a Research Scientist in the Robotics Institute at Carnegie Mellon University where he conducts research in Computer Vision. Before joining the Robotics Institute in September 1998, he was a Graduate Research Assistant at Columbia University, where he obtained his Ph.D. in the Department of Computer Science. He also spent a summer visiting the Vision Technology Group at Microsoft Research. He received a B.A. in Mathmematics from Trinity College, Cambridge University in 1991, a M.Sc. in Computer Science from the University of Edinburgh in 1992, and a M.S. in Mathematics from Trinity College, Cambridge University in 1995. His current research interests include: face analysis (recognition, tracking, model building, and resolution enhancement), 3D reconstruction and vision/graphics, vision theory, vision for automotive applications, and projector-camera systems. For more details of his research, see his webpage: http://www.ri.cmu.edu/people/baker_simon.html
List Host: Dr. Gerard Medioni

Location: Olin Hall of Engineering (OHE) - Studio C

Audiences: Everyone Is Invited

Contact: Nancy Levien