Events Calendar

CS Colloquium: Amy Pavel (Carnegie Mellon University / AI/ML Apple) - Human-AI Systems for Creating and Understanding Videos

Speaker: Amy Pavel, Carnegie Mellon University / AI/ML Apple

Talk Title: Human-AI Systems for Creating and Understanding Videos

Series: CS Colloquium

Abstract: Video is becoming a core medium for communicating a wide range of content, including educational lectures, vlogs, and how-to tutorials. While videos are engaging and informative, they lack the familiar and useful affordances of text for browsing, skimming,and flexibly transforming information. This severely limits who can interact with video content and how they can interact with it, makes editing a laborious process, and means that much of the information in videos is not accessible to everyone.

But, what future systems will make videos useful for all users?

In this talk, I'll share my work creating interactive Human-AI systems that combine the benefits of multiple mediums of communication (e.g., text, video, and audio) in two key areas: 1) helping domain experts find content of interest in videos, and 2) making videos accessible to people who are blind or have visual impairments. First, I'll discuss core challenges of finding information in videos from interviews with domain experts and people with disabilities. Then, I will present new systems that leverage AI, and the results of technical and user evaluations that demonstrate system efficacy. I will conclude with how hybrid HCI-AI breakthroughs will make digital communication more effective and accessible in the future, and how new interactions can help us to realize the full potential of recent AI/ML advances.


Biography: Amy Pavel is a Postdoctoral Fellow at Carnegie Mellon University and a Research Scientist in AI/ML at Apple. Her research explores AI-driven interactive techniques for making digital communication effective and accessible for all. Her work creating Human-AI systems to improve communication has appeared at ACM/IEEE conferences including UIST, CHI, ASSETS, and VR. She recently served as an associate chair for the UIST and CHI program committees, received 2 best paper nominations at CHI, and was selected as a Rising Star in EECS. She previously received her Ph.D. in Computer Science at UC Berkeley, where her work developing interactive video abstractions was supported by an NDSEG fellowship and an EECS Excellence Award. Read more about her research at: https://urldefense.com/v3/__https://amypavel.com/__;!!LIr3w8kk_Xxm!_kp1txvo_2fY97o1Ag_-lE6oKo_wqfl1jqPYTl7GDZDnH5NsjUdzasIfRnuxsBo$



Host: Heather Culbertson / Bistra Dilkina

Audiences: Everyone Is Invited

Contact: Assistant to CS chair