Mon, May 09, 2022 @ 01:00 PM - 03:00 PM
Title: Creating Cross-Modal, Context-Aware Representations of Music for Downstream Tasks
PhD Candidate: Timothy Greer
Defense Committee: Prof. Shrikanth Narayanan (Chair), Prof. David Kempe,
Prof. Morteza Dehghani (External), Prof. Mohammad Soleymani, Prof. Jonas Kaplan
Date: Monday, May 9, 2022
Time: 1:00PM PST
Location: RTH 320 and Zoom
Abstract: With the ever-burgeoning market for music, film, television, and other consumable media, it has never been more important to study human music processing and multi-modal experience. Advances in computational approaches offer new ways to understand music content, and how it is experienced---both as a standalone medium and in context with other forms of media---in nuanced ways. This work identifies novel methods for representing music in a context-aware fashion which has applications in multimodal perception, music information retrieval, music emotion recognition, and recommender systems. This work also presents a music-specific transformer model that creates deep representations of audio that are enriched through a multi-task learning paradigm. By creating cross-modal, context-aware representations of music, it is possible to meaningfully capture music and media-related perception, a boon to researchers in affective computing, music information retrieval, and automatic music tagging.
Bio: Timothy is a Computer Science PhD Candidate with SAIL at the University of Southern California, where his primary research focuses on music processing and the human music listening experience. Before USC, Timothy worked at MIT Lincoln Laboratory on problems related to graph processing and natural language. In his free time, Timothy plays saxophone and keyboards in an award-winning indie-pop band called Saticöy.
Audiences: Everyone Is Invited
Contact: Lizsl De Leon