AI Seminar-Towards Socially Aware and Safe AI Agents

Speaker: Xuhui Zhou, Carnegie Mellon University

Talk Title: Towards Socially Aware and Safe AI Agents

Series: AI Seminar

Abstract: LLMs are increasingly playing agentic and social roles by interacting with users and tools. I’ll first introduce SOTOPIA, a framework for evaluating LLM social intelligence through interactive simulations. Showing that LLMs struggle with real-world social skills, I will then discuss the crucial role of information asymmetry, highlighting that LLMs cannot properly deal with the information asymmetry that is present in real interactions. Finally, I will introduce HAICosystem, a new framework for simulating and evaluating the safety of LLM agents in user-AI-tool interactions, showcasing the many safety issues that could arise from increasingly autonomous and tool-using agents. I will conclude with some future directions towards safe and socially intelligent LLM agents.
Meeting ID: 933 0676 1471Passcode: 2024

Biography: Xuhui Zhou is a third-year PhD student in Carnegie Mellon University’s Language Technologies Department (CMU LTI) advised by Maarten Sap. His research focuses on making NLP systems socially intelligent, aligning them with human social values. He has presented his work at top-tier NLP and AI conferences, receiving spotlights, and runner-up best paper at ICLR 2024, and EmeCom 2022. Additionally, he has been red-teaming for GPT-4. His work has been covered in the press, including The New York Times, Financial Times, and Marktechpost. He previously organized the workshop on Theory of Mind in Communicating Agents at ICML 2023 and he has served as a reviewer for major conferences, including NeurIPS, ICLR, ACL, EMNLP, etc.

Host: Abel Salinas and Maura Covaci

More Info: https://www.isi.edu/events/5285/towards-socially-aware-and-safe-ai-agents/

Webcast: https://usc.zoom.us/j/93306761471?pwd=EnUKnvfrE5WruxuYa1jtx6v7BhznSr.1

Location: Information Science Institute (ISI) - Virtual Only

WebCast Link: https://usc.zoom.us/j/93306761471?pwd=EnUKnvfrE5WruxuYa1jtx6v7BhznSr.1

Audiences: Everyone Is Invited

Contact: Pete Zamar

Event Link: https://www.isi.edu/events/5285/towards-socially-aware-and-safe-ai-agents/