A Critical Assessment of Generative Models for Synthetic Data Augmentation on Limited Pneumonia X-ray Data
Bioengineering · 14.12.2023 · 10 (12) · 1421
DOI: 10.3390/bioengineering10121421 ↗Kurz gefasst
Fachartikel in der Zeitschrift Bioengineering, online erschienen am 14.12.2023. Verfasst von Daniel Schaudt und 6 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Databases and Information Systems, Ulm University, James-Franck-Ring, 89081 Ulm, Germany. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 70 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Open Access Funding of the Ulm University.
Abstract (Originalsprache)
In medical imaging, deep learning models serve as invaluable tools for expediting diagnoses and aiding specialized medical professionals in making clinical decisions. However, effectively training deep learning models typically necessitates substantial quantities of high-quality data, a resource often lacking in numerous medical imaging scenarios. One way to overcome this deficiency is to artificially generate such images. Therefore, in this comparative study we train five generative models to artificially increase the amount of available data in such a scenario. This synthetic data approach is evaluated on a a downstream classification task, predicting four causes for pneumonia as well as healthy cases on 1082 chest X-ray images. Quantitative and medical assessments show that a Generative Adversarial Network (GAN)-based approach significantly outperforms more recent diffusion-based approaches on this limited dataset with better image quality and pathological plausibility. We show that better image quality surprisingly does not translate to improved classification performance by evaluating five different classification models and varying the amount of additional training data. Class-specific metrics like precision, recall, and F1-score show a substantial improvement by using synthetic images, emphasizing the data rebalancing effect of less frequent classes. However, overall performance does not improve for most models and configurations, except for a DreamBooth approach which shows a +0.52 improvement in overall accuracy. The large variance of performance impact in this study suggests a careful consideration of utilizing generative models for limited data scenarios, especially with an unexpected negative correlation between image quality and downstream classification improvement.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Institute of Databases and Information Systems, Ulm University, James-Franck-Ring, 89081 Ulm, Germany.
- DASU Transferzentrum für Digitalisierung, Analytics und Data Science Ulm, Olgastraße 94, 89073 Ulm, Germany.
- Department of Computer Science, Ulm University of Applied Science, Albert-Einstein-Allee 55, 89081 Ulm, Germany.
- Department of Radiology, University Hospital of Ulm, Albert-Einstein-Allee 23, 89081 Ulm, Germany.
ORCID-Profile: Daniel Schaudt, Reinhold von Schwerin, Meinrad Beer
Förderung
- Open Access Funding of the Ulm University
Zitieren
APA
Schaudt, D., Späte, C., von Schwerin, R., Reichert, M., von Schwerin, M., Beer, M., & Kloth, C. (2023). A Critical Assessment of Generative Models for Synthetic Data Augmentation on Limited Pneumonia X-ray Data. Bioengineering, 10(12), 1421. https://doi.org/10.3390/bioengineering10121421
Vancouver
Schaudt D, Späte C, von Schwerin R, Reichert M, von Schwerin M, Beer M, et al. A Critical Assessment of Generative Models for Synthetic Data Augmentation on Limited Pneumonia X-ray Data. Bioengineering. 2023;10(12):1421. doi:10.3390/bioengineering10121421
BibTeX
@article{Schaudt2023,
author = {Schaudt, Daniel and Späte, Christian and von Schwerin, Reinhold and Reichert, Manfred and von Schwerin, Marianne and Beer, Meinrad and Kloth, Christopher},
title = {A Critical Assessment of Generative Models for Synthetic Data Augmentation on Limited Pneumonia X-ray Data},
journal = {Bioengineering},
year = {2023},
volume = {10},
number = {12},
pages = {1421},
doi = {10.3390/bioengineering10121421}
}
EUVIMED