EUVIMEDEUVIMED entdecken
Open Access

Research and implementation of multi-disease diagnosis on chest X-ray based on vision transformer

Lan Huang, Jiong Ma, Hui Yang, Yan Wang

Quantitative Imaging in Medicine and Surgery · 2024-03 · 14 (3) · 2539-2555

DOI: 10.21037/qims-23-1280 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Quantitative Imaging in Medicine and Surgery, 2024-03. Verfasst von Lan Huang und 3 weiteren Autor:innen. Beteiligte Einrichtung: College of Computer Science and Technology, Jilin University, Changchun, China. Die Arbeit wurde bisher 11-mal zitiert (Crossref). Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Disease diagnosis in chest X-ray images has predominantly relied on convolutional neural networks (CNNs). However, Vision Transformer (ViT) offers several advantages over CNNs, as it excels at capturing long-term dependencies, exploring correlations, and extracting features with richer semantic information.

Methods

We adapted ViT for chest X-ray image analysis by making the following three key improvements: (I) employing a sliding window approach in the image sequence feature extraction module to divide the input image into blocks to identify small and difficult-to-detect lesion areas; (II) introducing an attention region selection module in the encoder layer of the ViT model to enhance the model's ability to focus on relevant regions; and (III) constructing a parallel patient metadata feature extraction network on top of the image feature extraction network to integrate multi-modal input data, enabling the model to synergistically learn and expand image-semantic information.

Results

The experimental results showed the effectiveness of our proposed model, which had an average area under the curve value of 0.831 in diagnosing 14 common chest diseases. The metadata feature network module effectively integrated patient metadata, further enhancing the model's accuracy in diagnosis. Our ViT-based model had a sensitivity of 0.863, a specificity of 0.821, and an accuracy of 0.834 in diagnosing these common chest diseases.

Conclusions

Our model has good general applicability and shows promise in chest X-ray image analysis, effectively integrating patient metadata and enhancing diagnostic capabilities.

Schlagwörter

Stichwörter der Autor:innen

Medical image classificationchest X-ray imagesdisease diagnosismetadatavisual self-attention model

Autor:innen und Institutionen

  • College of Computer Science and Technology, Jilin University, Changchun, China.
  • Public Computer Education and Research Center, Jilin University, Changchun, China.

Zitieren

APA

Huang, L., Ma, J., Yang, H., & Wang, Y. (2024). Research and implementation of multi-disease diagnosis on chest X-ray based on vision transformer. Quantitative Imaging in Medicine and Surgery, 14(3), 2539-2555. https://doi.org/10.21037/qims-23-1280

Vancouver

Huang L, Ma J, Yang H, Wang Y. Research and implementation of multi-disease diagnosis on chest X-ray based on vision transformer. Quantitative Imaging in Medicine and Surgery. 2024;14(3):2539-2555. doi:10.21037/qims-23-1280

BibTeX
@article{Huang2024,
  author = {Huang, Lan and Ma, Jiong and Yang, Hui and Wang, Yan},
  title = {Research and implementation of multi-disease diagnosis on chest X-ray based on vision transformer},
  journal = {Quantitative Imaging in Medicine and Surgery},
  year = {2024},
  volume = {14},
  number = {3},
  pages = {2539--2555},
  doi = {10.21037/qims-23-1280}
}
Kostenlos starten →