Events Calendar

PhD Thesis Proposal - Hexiang Hu

Title of the Presentation:
Understanding Language in Perception and Embodiment

Committee: Fei Sha (Chair); Jay Kuo, Joseph Lim, Jesse Thomason, Robin Jia

Abstract:
Neural networks have made impressive progress in Natural Langauge Processing, which positively influenced many real-world tasks. Despite their success, language learners are often constrained as they are exposed only to the text world (from curated corpus or the internet). Consequently, language learners can not associate the learned distributional semantics with their appearance and affordance in the physical world. In this thesis proposal, I discuss approaches that learn to understand the language in the context of the visual dynamic world, which associate the hierarchical language expressions (such as word, phrase, sentence, and paragraph) with dynamic visual content (such as image and video). Moreover, I also discuss the future directions to understand the language in the embodied environment.

Link to the virtual meeting: https://usc.zoom.us/j/99351730951

WebCast Link: https://usc.zoom.us/j/99351730951

Audiences: Everyone Is Invited

Contact: Lizsl De Leon