Multi-Label Generalized Zero Shot Chest X-Ray Classification by Combining Image-Text Information With Feature Disentanglement
IEEE Transactions on Medical Imaging · 2025
DOI: 10.1109/tmi.2024.3429471 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Medical Imaging, 2025. Verfasst von Dwarikanath Mahapatra und 5 weiteren Autor:innen. Hauptthemen laut MEDLINE: Radiography, Thoracic, Radiographic Image Interpretation, Computer-Assisted. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 58 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Swiss National Foundation, Innosuisse - Schweizerische Agentur für Innovationsförderung.
Abstract (Originalsprache)
In fully supervised learning-based medical image classification, the robustness of a trained model depends on its exposure to various disease classes. Generalized Zero Shot Learning (GZSL) aims to predict both seen and novel unseen classes. While most GZSL approaches focus on single-label cases, chest X-rays often have multiple disease labels. We propose a novel multi-modal multi-label GZSL approach that leverages feature disentanglement and multi-modal information to synthesize features of unseen classes. Disease labels are processed through a pre-trained BioBert model to obtain text embeddings, which create a dictionary encoding similarity among labels. We use disentangled features and graph aggregation to learn a second dictionary of inter-label similarities, followed by clustering to identify representative vectors for each class. These dictionaries and representative vectors guide the feature synthesis step, generating realistic multi-label disease samples of seen and unseen classes. Our method outperforms competing methods in experiments on the NIH and CheXpert chest X-ray datasets.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Förderung
- Swiss National Foundation
- Innosuisse - Schweizerische Agentur für Innovationsförderung
Zitieren
APA
Mahapatra, D., Jimeno Yepes, A., Bozorgtabar, B., Roy, S., Ge, Z., & Reyes, M. (2025). Multi-Label Generalized Zero Shot Chest X-Ray Classification by Combining Image-Text Information With Feature Disentanglement. IEEE Transactions on Medical Imaging. https://doi.org/10.1109/tmi.2024.3429471
Vancouver
Mahapatra D, Jimeno Yepes A, Bozorgtabar B, Roy S, Ge Z, Reyes M. Multi-Label Generalized Zero Shot Chest X-Ray Classification by Combining Image-Text Information With Feature Disentanglement. IEEE Transactions on Medical Imaging. 2025. doi:10.1109/tmi.2024.3429471
BibTeX
@article{Mahapatra2025,
author = {Mahapatra, Dwarikanath and Jimeno Yepes, Antonio and Bozorgtabar, Behzad and Roy, Sudipta and Ge, Zongyuan and Reyes, Mauricio},
title = {Multi-Label Generalized Zero Shot Chest X-Ray Classification by Combining Image-Text Information With Feature Disentanglement},
journal = {IEEE Transactions on Medical Imaging},
year = {2025},
doi = {10.1109/tmi.2024.3429471}
}
EUVIMED