Events Calendar

PhD Dissertation Defense - Mianlun Zheng

Title: Real-time Multi-Resolution Neural Networks for Hand Simulation
 
Date and Time: Thursday, September 19th, 2024 - 2:00pm - 4:00pm
 
Location: EEB 539
 
Committee Members: Jernej Barbic, Oded Stein, and Jay Kuo
 
Abstract:
We present a method to simulate the hand’s musculoskeletal organs in any pose within the hand's range of motion. This method produces external hand shapes and internal organ shapes that match ground truth optical scans and medical images (MRI) in multiple scanned poses. Our system models bones, muscles, tendons, joint ligaments, and fat as separate volumetric organs that mechanically interact through contact and attachments. The match to MRI is achieved by incorporating pose-space deformation and plastic strains into the simulation. We evaluated our method by comparing it to optical scans and demonstrated that we qualitatively and quantitatively substantially decreased the error compared to previous work. Furthermore, we proposed a hard real-time machine learning shape deformer that reproduces high-quality shapes of a hero character at multiple levels of detail (LODs) and at fast speeds (a few milliseconds at most), targeting modern real-time applications.

Location: Hughes Aircraft Electrical Engineering Center (EEB) - 539

Audiences: Everyone Is Invited

Contact: Mianlun Zheng