
CS & ML Colloquium: Matus Telgarsky (UIUC)  Representation power of neural networks
Thu, Apr 27, 2017 @ 04:00 PM  05:00 PM
Computer Science
Conferences, Lectures, & Seminars
Speaker: Matus Telgarsky, UIUC
Talk Title: Representation power of neural networks
Series: Yahoo! Labs Machine Learning Seminar Series
Abstract: This lecture satisfies requirements for CSCI 591: Computer Science Research Colloquium.
This talk will present a series of mathematical vignettes on the representation power of neural networks. Amongst old results, the classical universal approximation theorem will be presented, along with Kolmogorov's superposition theorem. Recent results will include depth hierarchies (for any choice of depth, there exists functions which can only be approximated by slightly less deep networks when they have exponential size), connections to polynomials (namely, rational functions and neural networks wellapproximate each other), and the power of recurrent networks. Open problems will be sprinkled throughout.
Biography: Matus Telgarsky is an assistant professor at UIUC. He received his PhD in 2013 at UCSD under Sanjoy Dasgupta. He works in machine learning theory; his current interests are nonconvex optimization and neural network representation.
Host: CS Department
Location: Henry Salvatori Computer Science Center (SAL)  101
Audiences: Everyone Is Invited
Contact: Assistant to CS chair