Machine Learning Center Seminar

Speaker: Pengtao Xie , Assistant Professor, Department of Electrical and Computer Engineering - University of California, San Diego

Talk Title: Foundation Models and Generative AI for Medical Imaging Segmentation in Ultra-Low Data Regimes

Abstract: Semantic segmentation of medical images is pivotal in disease diagnosis and treatment planning. While deep learning has excelled in automating this task, a major hurdle is the need for numerous annotated masks, which are resource-intensive to produce due to the required expertise and time. This scenario often leads to ultra-low data regimes where annotated images are scarce, challenging the generalization of deep learning models on test images. To address this, we introduce two complementary approaches. One involves developing foundation models. The other involves generating high-fidelity training data consisting of paired segmentation masks and medical images. In the former, our bi-level optimization based method can effectively adapt the general-domain Segment Anything Model (SAM) to the medical domain with just a few medical images. In the latter, our multi-level optimization based method can perform end-to-end generation of high-quality training data from a minimal number of real images. On eight segmentation tasks involving various diseases, organs, and imaging modalities, our methods demonstrate strong generalization performance in both in-domain and out-of-domain settings. Our methods require 8-12 times less training data than baselines to achieve comparable performance.

Biography: Pengtao Xie is an assistant professor in the Department of Electrical and Computer Engineering at the University of California San Diego. His research interest lies in machine learning for healthcare. His PhD thesis was selected as a top-5 finalist for the Doctoral Dissertation Award of the American Medical Informatics Association (AMIA). He was recognized as Global Top-100 Chinese Young Scholars in Artificial Intelligence by Baidu, Tencent AI-Lab Faculty Award, Innovator Award by the Pittsburgh Business Times, Amazon AWS Machine Learning Research Award, among others. He serves as an associate editor for the ACM Transactions on Computing for Healthcare, senior area chair for AAAI, area chairs for ICML and NeurIPS, etc.

Host: Machine Learning Center

Location: Ronald Tutor Hall of Engineering (RTH) - 211

Audiences: Everyone Is Invited

Contact: Thomas Lord Department of Computer Science