Events Calendar

AI Seminar- Understanding LLMs through their Generative Behavior, Successes and Shortcomings

Speaker: Swabha Swayamdipta, USC

Talk Title: Understanding LLMs through their Generative Behavior, Successes and Shortcomings

Series: AI Seminar

Abstract: Abstract: Generative capabilities of large language models have grown beyond the wildest imagination of the broader AI research community, leading many to speculate whether these successes may be attributed to the training data or model design. I will present some work from my group which sheds light on understanding LLMs by studying their generative behavior, successes and shortcomings. First, I will show that standard inference algorithms work well because of the particular design behind LLMs. Next, I will discuss recently found successes and failures of LLMs on a combination of tasks, requiring world and domain-specific knowledge, linguistic capabilities and awareness of human and social utility. Overall, these findings paint a partial yet complex picture of our understanding of LLMs and provide a guide to the next steps forward.
 
This event will be recorded.
It will be posted on our USC/ISI YouTube page within 1-2 business days: https://www.youtube.com/user/USCISI.

Biography: Swabha Swayamdipta is an Assistant Professor of Computer Science and a Gabilan Assistant Professor at the University of Southern California. Her research interests are in natural language processing and machine learning, with a primary interest in the estimation of dataset quality, understanding and evaluation of generative models of language, and using language technologies to understand social behavior. At USC, Swabha leads the Data, Interpretability, Language and Learning (DILL) Lab. She received her PhD from Carnegie Mellon University, followed by a postdoc at the Allen Institute for AI. Her work has received outstanding paper awards at ICML 2022, NeurIPS 2021 and an honorable mention for the best paper at ACL 2020. Her research is supported by awards from the Allen Institute for AI and Intel Labs.

Host: Jay Pujara and Karen Lake

More Info: https://www.isi.edu/events/4684/ai-seminar-understanding-llms-through-their-generative-behavior-successes-and-shortcomings/

Webcast: https://usc.zoom.us/j/95888595423?pwd=VHBLa041dUJWcWx0NEhuYmQrV29ZQT09

Location: Information Science Institute (ISI) - Conf Rm#1135-37

WebCast Link: https://usc.zoom.us/j/95888595423?pwd=VHBLa041dUJWcWx0NEhuYmQrV29ZQT09

Audiences: Everyone Is Invited

Contact: Pete Zamar

Event Link: https://www.isi.edu/events/4684/ai-seminar-understanding-llms-through-their-generative-behavior-successes-and-shortcomings/