Events Calendar

PhD Thesis Proposal - Xisen Jin

PhD Thesis Proposal - Xisen Jin
 
Committee Members: Xiang Ren (advisor), Jesse Thomason, Robin Jia, Mahdi Soltanolkotabi, Jieyu Zhao
 
Title:  Building Updatable Language Model Systems in the Wild
 
Abstract: Building updatable language model systems has become a crucial challenge  alongside the progress of large language models. In this thesis proposal, I will present my efforts on creating resources, developing efficient methods, and analyzing learning dynamics in updating language models. I will introduce two of my past works, focused on lifelong pretraining of language models and fusing knowledge of multiple models by merging their weights. I will then introduce my on-going study of analyzing and forecasting examples that will be forgotten by model updates to reduce forgetting that happens during the process of model updates.

Audiences: Everyone Is Invited

Contact: Melissa Ochoa

Event Link: https://usc.zoom.us/j/92405014194?pwd=RlpqYzNKejZEQ1J1alhQYjBqN3dNZz09