We propose and demonstrate a novel approach to training image classification models based on large collections of images with limited labels. We take advantage of availability of radiology reports to construct joint multimodal embedding that serves as a basis for classification. We demonstrate the advantages of this approach in application to assessment of pulmonary edema severity in congestive heart failure that motivated the development of the method.
- Speaker: Polina Golland, MIT
- Monday 12 June 2023, 11:00–12:00
- Venue: Meeting Room 2, Pavilion A, Centre for Mathematical Sciences.
- Series: CMIH Hub seminar series; organiser: Paula Smith.