EUVIMEDEUVIMED entdecken
Systematische ÜbersichtOpen Access

Systematic Review of Hybrid Vision Transformer Architectures for Radiological Image Analysis

Ji Woong Kim, Aisha Urooj Khan, Imon Banerjee

Journal of Imaging Informatics in Medicine · 27.01.2025 · 38 (5) · 3248-3262

DOI: 10.1007/s10278-024-01322-4 ↗

Kurz gefasst

Systematische Übersicht in der Zeitschrift Journal of Imaging Informatics in Medicine, online erschienen am 27.01.2025. Verfasst von Ji Woong Kim und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Computing, Informatics, and Decision Systems Engineering, Arizona State University, Tempe, AZ, USA. Hauptthemen laut MEDLINE: Neural Networks, Computer, Image Processing, Computer-Assisted. Die Arbeit wurde bisher 80-mal zitiert (Crossref) und nennt 55 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NCI NIH HHS, NHLBI NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Vision transformer (ViT)and convolutional neural networks (CNNs) each possess distinct strengths in medical imaging: ViT excels in capturing long-range dependencies through self-attention, while CNNs are adept at extracting local features via spatial convolution filters. While ViT may struggle with capturing detailed local spatial information, critical for tasks like anomaly detection in medical imaging, shallow CNNs often fail to effectively abstract global context. This study aims to explore and evaluate hybrid architectures that integrate ViT and CNN to leverage their complementary strengths for enhanced performance in medical vision tasks, such as segmentation, classification, reconstruction, and prediction. Following PRISMA guideline, a systematic review was conducted on 34 articles published between 2020 and Sept. 2024. These articles proposed novel hybrid ViT-CNN architectures specifically for medical imaging tasks in radiology. The review focused on analyzing architectural variations, merging strategies between ViT and CNN, innovative applications of ViT, and efficiency metrics including parameters, inference time (GFlops), and performance benchmarks. The review identified that integrating ViT and CNN can mitigate the limitations of each architecture offering comprehensive solutions that combine global context understanding with precise local feature extraction. We benchmarked the articles based on architectural variations, merging strategies, innovative uses of ViT, and efficiency metrics (number of parameters, inference time (GFlops), and performance), and derived a ranked list. By synthesizing current literature, this review defines fundamental concepts of hybrid vision transformers and highlights emerging trends in the field. It provides a clear direction for future research aimed at optimizing the integration of ViT and CNN for effective utilization in medical imaging, contributing to advancements in diagnostic accuracy and image analysis. We performed systematic review of hybrid vision transformer architecture using PRISMA guideline and performed thorough comparative analysis to benchmark the architectures.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Neural Networks, ComputerImage Processing, Computer-AssistedHumans

Stichwörter der Autor:innen

Hybrid architectureImage analysisRadiologyVision transformer

Autor:innen und Institutionen

  • School of Computing, Informatics, and Decision Systems Engineering, Arizona State University, Tempe, AZ, USA.
  • Department of Radiology, Mayo Clinic, Phoenix, AZ, USA.
  • School of Computing, Informatics, and Decision Systems Engineering, Arizona State University, Tempe, AZ, USA. Banerjee.Imon@mayo.edu.
  • Department of Radiology, Mayo Clinic, Phoenix, AZ, USA. Banerjee.Imon@mayo.edu.
  • Department of Artificial Intelligence and Informatics (AI&I), Mayo Clinic, Scottsdale, AZ, USA. Banerjee.Imon@mayo.edu.

Förderung

  • NCI NIH HHS
  • NHLBI NIH HHS

Zitieren

APA

Kim, J. W., Khan, A. U., & Banerjee, I. (2025). Systematic Review of Hybrid Vision Transformer Architectures for Radiological Image Analysis. Journal of Imaging Informatics in Medicine, 38(5), 3248-3262. https://doi.org/10.1007/s10278-024-01322-4

Vancouver

Kim JW, Khan AU, Banerjee I. Systematic Review of Hybrid Vision Transformer Architectures for Radiological Image Analysis. Journal of Imaging Informatics in Medicine. 2025;38(5):3248-3262. doi:10.1007/s10278-024-01322-4

BibTeX
@article{Kim2025,
  author = {Kim, Ji Woong and Khan, Aisha Urooj and Banerjee, Imon},
  title = {Systematic Review of Hybrid Vision Transformer Architectures for Radiological Image Analysis},
  journal = {Journal of Imaging Informatics in Medicine},
  year = {2025},
  volume = {38},
  number = {5},
  pages = {3248--3262},
  doi = {10.1007/s10278-024-01322-4}
}
Kostenlos starten →