EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A multi-modal deep learning solution for precise pneumonia diagnosis: the PneumoFusion-Net model

Yujie Wang, Can Liu, Yinghan Fan, Chenyue Niu, Wanyun Huang, Yixuan Pan, Jingze Li, Yilin Wang, Jun Li

Frontiers in Physiology · 12.03.2025 · 16

DOI: 10.3389/fphys.2025.1512835 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Physiology, online erschienen am 12.03.2025. Verfasst von Yujie Wang und 8 weiteren Autor:innen. Beteiligte Einrichtung: College of Information Engineering, Sichuan Agricultural University, Ya'an, China. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 67 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Pneumonia is considered one of the most important causes of morbidity and mortality in the world. Bacterial and viral pneumonia share many similar clinical features, thus making diagnosis a challenging task. Traditional diagnostic method developments mainly rely on radiological imaging and require a certain degree of consulting clinical experience, which can be inefficient and inconsistent. Deep learning for the classification of pneumonia in multiple modalities, especially integrating multiple data, has not been well explored.

Methods

The study introduce the PneumoFusion-Net, a deep learning-based multimodal framework that incorporates CT images, clinical text, numerical lab test results, and radiology reports for improved diagnosis. In the experiments, a dataset of 10,095 pneumonia CT images was used-including associated clinical data-most of which was used for training and validation while keeping part of it for validation on a held-out test set. Five-fold cross-validation was considered in order to evaluate this model, calculating different metrics including accuracy and F1-Score.

Results

PneumoFusion-Net, which achieved 98.96% classification accuracy with a 98% F1-score on the held-out test set, is highly effective in distinguishing bacterial from viral types of pneumonia. This has been highly beneficial for diagnosis, reducing misdiagnosis and further improving homogeneity across various data sets from multiple patients.

Conclusion

PneumoFusion-Net offers an effective and efficient approach to pneumonia classification by integrating diverse data sources, resulting in high diagnostic accuracy. Its potential for clinical integration could significantly reduce the burden of pneumonia diagnosis by providing radiologists and clinicians with a robust, automated diagnostic tool.

Schlagwörter

Stichwörter der Autor:innen

PneumoFuison-Netclinical data integrationdeep learningmultimodal frameworkpneumonia classification

Autor:innen und Institutionen

  • College of Information Engineering, Sichuan Agricultural University, Ya'an, China.
  • Deep Vision Agriculture Lab, Sichuan Agricultural University, Ya'an, China.
  • College of Science, Sichuan Agricultural University, Ya'an, China.
  • Agricultural Information Engineering Higher Institution Key Laboratory of Sichuan Province, Ya'an, China.
  • Ya'an Digital Agricultural Engineering Technology Research Center, Ya'an, China.

Zitieren

APA

Wang, Y., Liu, C., Fan, Y., Niu, C., Huang, W., Pan, Y., Li, J., Wang, Y., & Li, J. (2025). A multi-modal deep learning solution for precise pneumonia diagnosis: the PneumoFusion-Net model. Frontiers in Physiology, 16. https://doi.org/10.3389/fphys.2025.1512835

Vancouver

Wang Y, Liu C, Fan Y, Niu C, Huang W, Pan Y, et al. A multi-modal deep learning solution for precise pneumonia diagnosis: the PneumoFusion-Net model. Frontiers in Physiology. 2025;16. doi:10.3389/fphys.2025.1512835

BibTeX
@article{Wang2025,
  author = {Wang, Yujie and Liu, Can and Fan, Yinghan and Niu, Chenyue and Huang, Wanyun and Pan, Yixuan and Li, Jingze and Wang, Yilin and Li, Jun},
  title = {A multi-modal deep learning solution for precise pneumonia diagnosis: the PneumoFusion-Net model},
  journal = {Frontiers in Physiology},
  year = {2025},
  volume = {16},
  doi = {10.3389/fphys.2025.1512835}
}
Kostenlos starten →