Events Calendar

NL Seminar-Towards interactive story generation

Speaker: Mohit Iyyer, U Mass (Amherst)

Talk Title: Towards interactive story generation

Abstract: Story generation is difficult to computationally formalize and evaluate, and there are many important questions to ask when tackling the problem. What should we consider as the base unit of a story e.g., a sentence? a paragraph? a chapter? What kind of data should we use to train these models novels? short stories? overly simplistic mechanically turked paragraphs?) Is any model architecture currently capable of producing long-form narratives that have some semblance of coherent discourse structure, such as plot arcs and character development? When evaluating the outputs of our models, can we do better than just asking people to rate the text based on vaguely defined properties such as enjoyability? In this talk, I'll discuss my lab's ongoing work on story generation by introducing a new dataset and evaluation method that we hope will spur progress in this area, and also describing fine-tuning strategies for large scale Transformers that produce more coherent and stylistically consistent stories. A major bottleneck of these models is their memory and speed inefficiency; as such, I'll conclude by discussing heavily simplified Transformer language models that make training less expensive without sacrificing output quality.


Biography: Mohit Iyyer is an assistant professor in computer science at the University of Massachusetts Amherst. His research focuses broadly on designing machine learning models for discourse level language generation e.g., for story generation and machine translation), and his group also works on tasks involving creative language understanding e.g., modeling fictional narratives and characters. He is the recipient of best paper awards at NAACL 2016, 2018 and a best demo award at NeurIPS 2015. He received his PhD in computer science from the University of Maryland, College Park in 2017, advised by Jordan Boyd Graber and Hal Daumé III, and spent the following year as a researcher at the Allen Institute for Artificial Intelligence.

Host: Jon May and Emily Sheng

More Info: https://nlg.isi.edu/nl-seminar/

Location: Information Science Institute (ISI) - Meeting ID: 938 5732 1879 /Password: 073790

Audiences: Everyone Is Invited

Contact: Petet Zamar

Event Link: https://nlg.isi.edu/nl-seminar/