EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Critical Assessment of Generative Models for Synthetic Data Augmentation on Limited Pneumonia X-ray Data

Daniel Schaudt iD, Christian Späte, Reinhold von Schwerin iD, Manfred Reichert, Marianne von Schwerin, Meinrad Beer iD, Christopher Kloth

Bioengineering · 14.12.2023 · 10 (12) · 1421

DOI: 10.3390/bioengineering10121421 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Bioengineering, online erschienen am 14.12.2023. Verfasst von Daniel Schaudt und 6 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Databases and Information Systems, Ulm University, James-Franck-Ring, 89081 Ulm, Germany. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 70 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Open Access Funding of the Ulm University.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In medical imaging, deep learning models serve as invaluable tools for expediting diagnoses and aiding specialized medical professionals in making clinical decisions. However, effectively training deep learning models typically necessitates substantial quantities of high-quality data, a resource often lacking in numerous medical imaging scenarios. One way to overcome this deficiency is to artificially generate such images. Therefore, in this comparative study we train five generative models to artificially increase the amount of available data in such a scenario. This synthetic data approach is evaluated on a a downstream classification task, predicting four causes for pneumonia as well as healthy cases on 1082 chest X-ray images. Quantitative and medical assessments show that a Generative Adversarial Network (GAN)-based approach significantly outperforms more recent diffusion-based approaches on this limited dataset with better image quality and pathological plausibility. We show that better image quality surprisingly does not translate to improved classification performance by evaluating five different classification models and varying the amount of additional training data. Class-specific metrics like precision, recall, and F1-score show a substantial improvement by using synthetic images, emphasizing the data rebalancing effect of less frequent classes. However, overall performance does not improve for most models and configurations, except for a DreamBooth approach which shows a +0.52 improvement in overall accuracy. The large variance of performance impact in this study suggests a careful consideration of utilizing generative models for limited data scenarios, especially with an unexpected negative correlation between image quality and downstream classification improvement.

Schlagwörter

Stichwörter der Autor:innen

deep learninggenerative modelsmedical imagingpneumoniasynthetic data

Autor:innen und Institutionen

  • Institute of Databases and Information Systems, Ulm University, James-Franck-Ring, 89081 Ulm, Germany.
  • DASU Transferzentrum für Digitalisierung, Analytics und Data Science Ulm, Olgastraße 94, 89073 Ulm, Germany.
  • Department of Computer Science, Ulm University of Applied Science, Albert-Einstein-Allee 55, 89081 Ulm, Germany.
  • Department of Radiology, University Hospital of Ulm, Albert-Einstein-Allee 23, 89081 Ulm, Germany.

ORCID-Profile: Daniel Schaudt, Reinhold von Schwerin, Meinrad Beer

Förderung

  • Open Access Funding of the Ulm University

Zitieren

APA

Schaudt, D., Späte, C., von Schwerin, R., Reichert, M., von Schwerin, M., Beer, M., & Kloth, C. (2023). A Critical Assessment of Generative Models for Synthetic Data Augmentation on Limited Pneumonia X-ray Data. Bioengineering, 10(12), 1421. https://doi.org/10.3390/bioengineering10121421

Vancouver

Schaudt D, Späte C, von Schwerin R, Reichert M, von Schwerin M, Beer M, et al. A Critical Assessment of Generative Models for Synthetic Data Augmentation on Limited Pneumonia X-ray Data. Bioengineering. 2023;10(12):1421. doi:10.3390/bioengineering10121421

BibTeX
@article{Schaudt2023,
  author = {Schaudt, Daniel and Späte, Christian and von Schwerin, Reinhold and Reichert, Manfred and von Schwerin, Marianne and Beer, Meinrad and Kloth, Christopher},
  title = {A Critical Assessment of Generative Models for Synthetic Data Augmentation on Limited Pneumonia X-ray Data},
  journal = {Bioengineering},
  year = {2023},
  volume = {10},
  number = {12},
  pages = {1421},
  doi = {10.3390/bioengineering10121421}
}
Kostenlos starten →