Research and implementation of multi-disease diagnosis on chest X-ray based on vision transformer
Quantitative Imaging in Medicine and Surgery · 2024-03 · 14 (3) · 2539-2555
DOI: 10.21037/qims-23-1280 ↗Kurz gefasst
Fachartikel in der Zeitschrift Quantitative Imaging in Medicine and Surgery, 2024-03. Verfasst von Lan Huang und 3 weiteren Autor:innen. Beteiligte Einrichtung: College of Computer Science and Technology, Jilin University, Changchun, China. Die Arbeit wurde bisher 11-mal zitiert (Crossref). Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
Disease diagnosis in chest X-ray images has predominantly relied on convolutional neural networks (CNNs). However, Vision Transformer (ViT) offers several advantages over CNNs, as it excels at capturing long-term dependencies, exploring correlations, and extracting features with richer semantic information.
Methods
We adapted ViT for chest X-ray image analysis by making the following three key improvements: (I) employing a sliding window approach in the image sequence feature extraction module to divide the input image into blocks to identify small and difficult-to-detect lesion areas; (II) introducing an attention region selection module in the encoder layer of the ViT model to enhance the model's ability to focus on relevant regions; and (III) constructing a parallel patient metadata feature extraction network on top of the image feature extraction network to integrate multi-modal input data, enabling the model to synergistically learn and expand image-semantic information.
Results
The experimental results showed the effectiveness of our proposed model, which had an average area under the curve value of 0.831 in diagnosing 14 common chest diseases. The metadata feature network module effectively integrated patient metadata, further enhancing the model's accuracy in diagnosis. Our ViT-based model had a sensitivity of 0.863, a specificity of 0.821, and an accuracy of 0.834 in diagnosing these common chest diseases.
Conclusions
Our model has good general applicability and shows promise in chest X-ray image analysis, effectively integrating patient metadata and enhancing diagnostic capabilities.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- College of Computer Science and Technology, Jilin University, Changchun, China.
- Public Computer Education and Research Center, Jilin University, Changchun, China.
Zitieren
APA
Huang, L., Ma, J., Yang, H., & Wang, Y. (2024). Research and implementation of multi-disease diagnosis on chest X-ray based on vision transformer. Quantitative Imaging in Medicine and Surgery, 14(3), 2539-2555. https://doi.org/10.21037/qims-23-1280
Vancouver
Huang L, Ma J, Yang H, Wang Y. Research and implementation of multi-disease diagnosis on chest X-ray based on vision transformer. Quantitative Imaging in Medicine and Surgery. 2024;14(3):2539-2555. doi:10.21037/qims-23-1280
BibTeX
@article{Huang2024,
author = {Huang, Lan and Ma, Jiong and Yang, Hui and Wang, Yan},
title = {Research and implementation of multi-disease diagnosis on chest X-ray based on vision transformer},
journal = {Quantitative Imaging in Medicine and Surgery},
year = {2024},
volume = {14},
number = {3},
pages = {2539--2555},
doi = {10.21037/qims-23-1280}
}
EUVIMED