Select a calendar:
Filter March Events by Event Type:
SUNMONTUEWEDTHUFRISAT
Events for March 19, 2024
-
CS Colloquium: Sherry Yang - Decision Making with Internet-Scale Knowledge
Tue, Mar 19, 2024 @ 10:00 AM - 11:00 AM
Thomas Lord Department of Computer Science
Conferences, Lectures, & Seminars
Speaker: Sherry Yang, UC Berkeley
Talk Title: Decision Making with Internet-Scale Knowledge
Abstract: Machine learning models pretrained on internet data have acquired broad knowledge about the world but struggle to solve complex tasks that require extended reasoning and planning. Sequential decision making, on the other hand, has empowered AlphaGo’s superhuman performance, but lacks visual, language, and physical knowledge about the world. In this talk, I will present my research towards enabling decision making with internet-scale knowledge. First, I will illustrate how language models and video generation are unified interfaces that can integrate internet knowledge and represent diverse tasks, enabling the creation of a generative simulator to support real-world decision-making. Second, I will discuss my work on designing decision making algorithms that can take advantage of generative language and video models as agents and environments. Combining pretrained models with decision making algorithms can effectively enable a wide range of applications such as developing chatbots, learning robot policies, and discovering novel materials. This lecture satisfies requirements for CSCI 591: Research Colloquium
Biography: Sherry is a final year PhD student at UC Berkeley advised by Pieter Abbeel and a senior research scientist at Google DeepMind. Her research aims to develop machine learning models with internet-scale knowledge to make better-than-human decisions. To this end, she has developed techniques for generative modeling and representation learning from large-scale vision, language, and structured data, coupled with developing algorithms for sequential decision making such as imitation learning, planning, and reinforcement learning. Sherry initiated and led the Foundation Models for Decision Making workshop at NeurIPS 2022 and 2023, bringing together research communities in vision, language, planning, and reinforcement learning to solve complex decision making tasks at scale. Before her current role, Sherry received her Bachelor’s degree and Master’s degree from MIT advised by Patrick Winston and Julian Shun.
Host: Dani Yogatama
Location: Olin Hall of Engineering (OHE) - 136
Audiences: Everyone Is Invited
Contact: CS Faculty Affairs
-
PhD Thesis Proposal - Yuzhong Huang
Tue, Mar 19, 2024 @ 11:00 AM - 12:00 PM
Thomas Lord Department of Computer Science
University Calendar
Committee Members: Fred Morstatter (Chair), Yue Wang, Aiichiro Nakano, & Antonio Ortega
Date & Time: Tuesday, March 19, 2024, 11:00 a.m. - 12:00 p.m. (PST) - PHE 325
Title: Explicit Control in the Understanding and Generation of 3D world
Abstract: Understanding and recreating our living environment has been a key topic in scientific research, ranging from virtual reality, autonomous driving, and generative AI tools. Recent advancements have significantly improved machine model’s capability to recognize and generate visually similar 3D objects. However, existing approaches often lack explicit control mechanisms, limiting their adaptability and interpretability. This thesis proposal addresses this gap by focusing on three crucial aspects: (1) Explicit control in understanding 3D worlds, achieved through the imposition of planar priors and plane-splatting volume rendering method. (2) Explicit control in generating 3D worlds, enabled by an orientation-conditioned diffusion model. (3) Explicit control in modifying 3D objects, enabled by projecting text-guided 2D segmentation map onto 3D models. These advancements pave the way for more intuitive and precise manipulation of 3D environments.
Zoom Link: https://usc.zoom.us/j/99330288526Location: Charles Lee Powell Hall (PHE) - 325
WebCast Link: https://usc.zoom.us/j/99330288526
Audiences: Everyone Is Invited
Contact: Thomas Lord Department of Computer Science
Event Link: https://usc.zoom.us/j/99330288526
-
PhD Thesis Proposal- Yuzhong Huang
Tue, Mar 19, 2024 @ 11:00 AM - 12:00 PM
Thomas Lord Department of Computer Science
Student Activity
PhD Thesis Proposal- Yuzhong Huang
Title: Explicit Control in the Understanding and Generation of 3D world
Committee Members: Fred Morstatter (Chair), Yue Wang, Aiichiro Nakano, Antonio Ortega
Abstract:
Understanding and recreating our living environment has been a key topic in scientific research, ranging from virtual reality, autonomous driving, and generative AI tools. Recent advancements have significantly improved machine model’s capability to recognize and generate visually similar 3D objects.
However, existing approaches often lack explicit control mechanisms, limiting their adaptability and interpretability. This thesis proposal addresses this gap by focusing on three crucial aspects: (1) Explicit control in understanding 3D worlds, achieved through the imposition of planar priors and plane-splatting volume rendering method. (2) Explicit control in generating 3D worlds, enabled by an orientation-conditioned diffusion model. (3) Explicit control in modifying 3D objects, enabled by projecting text-guided 2D segmentation map onto 3D models.
These advancements pave the way for more intuitive and precise manipulation of 3D environments.
Location: Charles Lee Powell Hall (PHE) - 325
Audiences: Everyone Is Invited
Contact: Yuzhong Huang
Event Link: https://usc.zoom.us/j/99330288526
