Events Calendar

CS Colloquium: Geoffrey Zweig (Microsoft Research) - High Performance Image Captioning

Speaker: Geoffrey Zweig, Microsoft Research

Talk Title: High Performance Image Captioning

Series: CS Colloquium

Abstract: This lecture satisfies requirements for CSCI 591: Computer Science Research Colloquium

The problem of generating text conditioned on some sort of side information arises in many areas including dialog systems, machine translation, speech recognition, and image captioning. In this talk, we present a highly effective method for generating text conditioned on a set of words that should be mentioned. We apply this to the problem of image captioning by linking the generation module to a convolutional neural network that predicts a set of words that are descriptive of an image. The system placed first in the 2015 MSCoco competition on the Turing Test measure, and tied for first place overall.

This event will be available to stream HERE.

Biography: Geoffrey Zweig is a Principal Researcher, and Manager of the Speech and Dialog Group at Microsoft Research. His work centers on developing improved algorithms for speech and language processing. Recent work has focused on applications of side-conditioned recurrent neural network language models, such as image captioning and grapheme to phoneme conversion. Prior to Microsoft, Dr. Zweig managed the Advanced Large Vocabulary Continuous Speech Recognition Group at IBM Research, with a focus on the DARPA EARS and GALE programs. In the course of his career, Dr. Zweig has written several speech recognition trainers and decoders, as well as toolkits for doing speech recognition with segmental conditional random fields, and for maximum entropy language modeling. Dr. Zweig received his PhD from the University of California at Berkeley. He is the author of over 80 papers, numerous patents, is an Associate Editor of Computers Speech and Language, and is a Fellow of the IEEE.


Host: Yan Liu

Webcast: https://bluejeans.com/996018929

Location: Henry Salvatori Computer Science Center (SAL) - 101

WebCast Link: https://bluejeans.com/996018929

Audiences: Everyone Is Invited

Contact: Assistant to CS chair