Tue, Oct 24, 2023 @ 11:00 AM - 12:00 PM
Thomas Lord Department of Computer Science
PhD Thesis Proposal - Xisen Jin
Committee Members: Xiang Ren (advisor), Jesse Thomason, Robin Jia, Mahdi Soltanolkotabi, Jieyu Zhao
Title: Building Updatable Language Model Systems in the Wild
Abstract: Building updatable language model systems has become a crucial challenge alongside the progress of large language models. In this thesis proposal, I will present my efforts on creating resources, developing efficient methods, and analyzing learning dynamics in updating language models. I will introduce two of my past works, focused on lifelong pretraining of language models and fusing knowledge of multiple models by merging their weights. I will then introduce my on-going study of analyzing and forecasting examples that will be forgotten by model updates to reduce forgetting that happens during the process of model updates.
Audiences: Everyone Is Invited
Contact: Melissa Ochoa