-
CS Colloquium: Phillip Isola (UC Berkeley) - Learning to See Without a Teacher
Thu, Oct 19, 2017 @ 03:30 PM - 04:50 PM
Thomas Lord Department of Computer Science
Conferences, Lectures, & Seminars
Speaker: Phillip Isola, UC Berkeley
Talk Title: Learning to See Without a Teacher
Series: Visa Research Machine Learning Seminar Series hosted by USC Machine Learning Center
Abstract: This lecture satisfies requirements for CSCI 591: Research Colloquium.
Over the past decade, learning-based methods have driven rapid progress in computer vision. However, most such methods still require a human "teacher" in the loop. Humans provide labeled examples of target behavior, and also define the objective that the learner tries to satisfy. The way learning plays out in nature is rather different: ecological scenarios involve huge quantities of unlabeled data and only a few supervised lessons provided by a teacher (e.g., a parent). I will present two directions toward computer vision algorithms that learn more like ecological agents. The first involves learning from unlabeled data. I will show how objects and semantics can emerge as a natural consequence of predicting raw data, rather than labels. The second is an approach to data prediction where we not only learn to make predictions, but also learn the objective function that scores the predictions. In effect, the algorithm learns not just how to solve a problem, but also what exactly needs to be solved in order to generate realistic outputs. Finally, I will talk about my ongoing efforts toward sensorimotor systems that not only learn from provided data but also act to sample more data on their own.
Biography: Phillip Isola is currently a Fellow at OpenAI, and he will be starting as an Assistant Professor in EECS at MIT in 2018. He received his Ph.D. in the Brain & Cognitive Sciences department at MIT, and spent two years as a postdoc in the EECS department at UC Berkeley. He studies visual intelligence from the perspective of both minds and machines.
Host: Joseph Lim
Location: Henry Salvatori Computer Science Center (SAL) - 101
Audiences: Everyone Is Invited
Contact: Computer Science Department