Logo: University of Southern California

Events Calendar

  • Center for Cyber-Physical Systems and Internet of Things and Ming Hsieh Institute Seminar

    Wed, Sep 09, 2020 @ 02:00 PM - 03:00 PM

    Ming Hsieh Department of Electrical and Computer Engineering

    Conferences, Lectures, & Seminars

    Speaker: Alan Mishchenko, Department of Electrical Engineering and Computer Sciences, University of California, Berkeley

    Talk Title: Circuit-Based Intrinsic Methods to Detect Overfitting

    Series: Center for Cyber-Physical Systems and Internet of Things

    Abstract: The focus of this talk is on intrinsic methods to detect overfitting. By intrinsic methods, we mean methods that rely only on the model and the training data, as opposed to traditional methods that rely on performance on a test set or on bounds from model complexity. We propose a family of intrinsic methods, called Counterfactual Simulation (CFS), which analyze the flow of training examples through the model by identifying and perturbing rare patterns. By applying CFS to logic circuits we get a method that has no hyper-parameters and works uniformly across different types of models such as neural networks, random forests and lookup tables. Experimentally, CFS can separate models with different levels of overfit using only their logic circuit representations without any access to the high level structure. By comparing lookup tables, neural networks, and random forests using CFS, we get insight into why neural networks generalize. The paper appeared at ICML 2020: https://people.eecs.berkeley.edu/~alanmi/publications/2020/icml20_cfs.pdf

    Biography: Alan graduated with M.S. from Moscow Institute of Physics and Technology (Moscow, Russia) in 1993 and received his Ph.D. from Glushkov Institute of Cybernetics (Kiev, Ukraine) in 1997. In 2002, Alan joined the EECS Department at the University of California, Berkeley, where he is currently a full researcher. His research is in computationally efficient logic synthesis and formal verification.

    Host: Pierluigi Nuzzo, nuzzo@usc.edu

    Webcast: https://usc.zoom.us/webinar/register/WN_YSl0DRVOQJetWGNAACPOYQ

    Location: Online

    WebCast Link: https://usc.zoom.us/webinar/register/WN_YSl0DRVOQJetWGNAACPOYQ

    Audiences: Everyone Is Invited

    Posted By: Talyia White


Return to Calendar