SUNMONTUEWEDTHUFRISAT
Events for November 08, 2023
-
Distinguished Lecturer Series: Dr. David Patterson
Wed, Nov 08, 2023 @ 03:00 PM - 05:00 PM
Ming Hsieh Department of Electrical and Computer Engineering
Conferences, Lectures, & Seminars
Speaker: Dr. David Patterson, UC Berkeley Pardee Professor of Computer Science, Emeritus | Vice Chair of the Board of Directors of RISC-V Foundation
Talk Title: A Decade of Machine Learning Accelerators: Lessons Learned and Carbon Footprint
Abstract: The success of deep neural networks (DNNs) from Machine Learning (ML) has inspired domain specific architectures (DSAs) for them. Google's first-generation DSA offered 50x improvement over conventional architectures for ML inference in 2015. Google next built the first production DSA supercomputer for the much harder problem of training. Subsequent generations greatly improved performance of both phases. We start with ten lessons learned from such efforts.
The rapid growth of DNNs rightfully raised concerns about their carbon footprint. The second part of the talk identifies the "4Ms" (Model, Machine, Mechanization, Map) that, if optimized, can reduce ML training energy by up to 100x and carbon emissions up to 1000x. By improving the 4Ms, ML held steady at
Biography: David Patterson is a UC Berkeley Pardee professor emeritus, a Google distinguished engineer, and the RISC-V International Vice-Chair. His most influential Berkeley projects likely were RISC (Reduced Instruction Set Computer) and RAID (Redundant Array of Inexpensive Disks). His best-known book is Computer Architecture: A Quantitative Approach. He and his co-author John Hennessy shared the 2017 ACM A.M Turing Award and the 2022 NAE Charles Stark Draper Prize for Engineering. The Turing Award is often referred to as the "Nobel Prize of Computing" and the Draper Prize is considered a "Nobel Prize of Engineering."
Host: Drs. Timothy Pinkston, Arash Saifhashemi
Location: EEB 132
Audiences: Everyone Is Invited
Contact: Miki Arlen
