Events Calendar

Center for Cyber-Physical Systems and Internet of Things and Ming Hsieh Institute Seminar

Speaker: Frederic Sala, Stanford Computer Science Department

Talk Title: Structure to the Rescue: Breaking Data Barriers in Machine Lear

Series: Center for Cyber-Physical Systems and Internet of Things

Abstract: The current machine learning zeitgeist is that models are only as good as the data they are fed, so that limitations in the data---and especially mismatches with the ML algorithm---present fundamental barriers to model performance. However, for ML to continue its growth and be safely and widely deployed across domains with significant societal impact, such limitations must be minimized. In this talk, I will describe two ways to exploit structure in data to overcome apparent obstacles, with theoretical guarantees.

First, I will argue that geometry is a barrier to producing quality representations used by models. The root cause is a mismatch between the geometric structure of the data and the geometry of the model---but the issue can be resolved by adopting matching non-Euclidean geometries, relying on, for example, hyperbolic geometry for hierarchical data. Next, motivated by the fact that labeling large datasets is a major bottleneck in supervised learning, I will discuss a weak supervision framework for automating the process of labeling, overcoming the lack of hand-labeled data. This is done by encapsulating different aspects of manual labeling into heuristics whose structure is characterized by learnable accuracies and correlations. I will describe extensions of this framework to handle multitask, time-series, and other forms of structured data. This framework is widely used in industry, helping drive applications used by millions daily.


Biography: Frederic Sala is a postdoctoral scholar in the Stanford Computer Science Department, advised by Chris Ré. His research interests include machine learning, data-driven systems, and information and coding theory, and in particular problems related to the analysis and design of algorithms that operate on diverse and challenging forms of data. He received the Ph.D. and M.S. degrees in Electrical Engineering from UCLA, where he received the Distinguished Ph.D. Dissertation in Signals & Systems Award from the UCLA Electrical Engineering Department, the NSF graduate fellowship, and the Edward K. Rice Outstanding Master's Student Award.

Host: Paul Bogdan, pbogdan@usc.edu

Location: Hughes Aircraft Electrical Engineering Center (EEB) - 248

Audiences: Everyone Is Invited

Contact: Talyia White