PhD Thesis Proposal- Yuzhong Huang

PhD Thesis Proposal- Yuzhong Huang

Title: Explicit Control in the Understanding and Generation of 3D world
Committee Members: Fred Morstatter (Chair), Yue Wang, Aiichiro Nakano, Antonio Ortega
 


Abstract: 


Understanding and recreating our living environment has been a key topic in scientific research, ranging from virtual reality, autonomous driving, and generative AI tools. Recent advancements have significantly improved machine model’s capability to recognize and generate visually similar 3D objects.


However, existing approaches often lack explicit control mechanisms, limiting their adaptability and interpretability. This thesis proposal addresses this gap by focusing on three crucial aspects: (1) Explicit control in understanding 3D worlds, achieved through the imposition of planar priors and plane-splatting volume rendering method. (2) Explicit control in generating 3D worlds, enabled by an orientation-conditioned diffusion model. (3) Explicit control in modifying 3D objects, enabled by projecting text-guided 2D segmentation map onto 3D models.


These advancements pave the way for more intuitive and precise manipulation of 3D environments.

Location: Charles Lee Powell Hall (PHE) - 325

Audiences: Everyone Is Invited

Contact: Yuzhong Huang

Event Link: https://usc.zoom.us/j/99330288526