Logo: University of Southern California

Events Calendar



Select a calendar:



Filter June Events by Event Type:



Events for June 17, 2021

  • NL Seminar PREFIX TUNING: OPTIMIZING CONTINUOUS PROMPTS FOR GENERATION

    Thu, Jun 17, 2021 @ 11:00 AM - 12:00 PM

    Information Sciences Institute

    Conferences, Lectures, & Seminars


    Speaker: Xiang Lisa Li, Stanford Unversity

    Talk Title: PREFIX-TUNING: OPTIMIZING CONTINUOUS PROMPTS FOR GENERATION

    Series: NL Seminar

    Abstract: Fine tuning is the de facto way of leveraging large pre trained language models for downstream tasks. However, fine tuning modifies all the language model parameters and therefore necessitates storing a full copy for each task. In this paper, we propose prefix tuning, a lightweight alternative to fine tuning for natural language generation tasks, which keeps language model parameters frozen and instead optimizes a sequence of continuous task specific vectors, which we call the prefix. Prefix tuning draws inspiration from prompting for language models, allowing subsequent tokens to attend to this prefix as if it were virtual tokens. We apply prefix tuning to GPT 2 for table to text generation and to BART for summarization. We show that by modifying only 0.1 percent of the parameters, prefix tuning obtains comparable performance in the full data setting, outperforms fine tuning in low data settings, and extrapolates better to examples with topics that are unseen during training.

    Biography: Xiang Lisa Li is a first year PhD student in computer science at Stanford University, advised by Percy Liang and Tatsunori Hashimoto. She works on controllable text generation/decoding and efficient adaptation of pre trained language models. Lisa is supported by a Stanford Graduate Fellowship and is the recipient of an EMNLP Best Paper award.





    Host: Jon May and Mozhdeh Gheini

    More Info: https://nlg.isi.edu/nl-seminar/

    Webcast: https://youtu.be/TwE2m6Z991s

    Location: Information Science Institute (ISI) - Virtual Only

    WebCast Link: https://youtu.be/TwE2m6Z991s

    Audiences: Everyone Is Invited

    Contact: Petet Zamar

    OutlookiCal
  • Repeating EventVirtual First-Year Admission Information Session

    Thu, Jun 17, 2021 @ 04:00 PM - 05:00 PM

    Viterbi School of Engineering Undergraduate Admission

    Workshops & Infosessions


    Our virtual information session is a live presentation from a USC Viterbi admission counselor designed for high school students and their family members to learn more about the USC Viterbi undergraduate experience. Our session will cover an overview of our undergraduate engineering programs, the application process, and more on student life. Guests will be able to ask questions and engage in further discussion toward the end of the session.

    Please Register Here!

    Audiences: Everyone Is Invited

    View All Dates

    Contact: Viterbi Admission

    OutlookiCal
  • Viterbi MS Orientation for Summer Start 2

    Thu, Jun 17, 2021 @ 05:00 PM - 07:00 PM

    Viterbi School of Engineering Masters Programs

    Student Activity


    The New Student Welcome is a mandatory live virtual event to start your first semester with a good foundation and prepare you for success. You will meet the VASE Master's Student Affairs Team, as well as your Academic Department Advisors, and have an opportunity to network with other students.
    Zoom link: https://usc.zoom.us/j/92111976242?pwd=Rlg3UUkzTTljVDdQSHpEZ04vWkdPQT09

    Audiences: Exclusive to Summer Start students

    Contact: Juli Legat

    OutlookiCal