EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

MSA ‐ MaxNet : Multi‐Scale Attention Enhanced Multi‐Axis Vision Transformer Network for Medical Image Segmentation

Wei Wu, Junfeng Huang, Mingxuan Zhang, Yichen Li, Qijia Yu, Qi Zhao iD

Journal of Cellular and Molecular Medicine · 2024-12 · 28 (24)

DOI: 10.1111/jcmm.70315 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Cellular and Molecular Medicine, online erschienen am 20.12.2024. Verfasst von Wei Wu und 5 weiteren Autor:innen. Beteiligte Einrichtung: School of Computer Science and Software Engineering, University of Science and Technology Liaoning, Anshan, China. Hauptthemen laut MEDLINE: Neural Networks, Computer, Image Processing, Computer-Assisted. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Science Foundation of Liaoning Province, Fundamental Research Funds for the Liaoning Universities.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Convolutional neural networks (CNNs) are well established in handling local features in visual tasks; yet, they falter in managing complex spatial relationships and long‐range dependencies that are crucial for medical image segmentation, particularly in identifying pathological changes. While vision transformer (ViT) excels in addressing long‐range dependencies, their ability to leverage local features remains inadequate. Recent ViT variants have merged CNNs to improve feature representation and segmentation outcomes, yet challenges with limited receptive fields and precise feature representation persist. In this work, we propose MSA‐MaxNet. Specifically, our model utilises an encoder–decoder structure, using MaxViT blocks that apply multi‐axis self‐attention (Max‐SA) as the encoder for local and global feature extraction. To restore the feature map's spatial resolution during upsampling operations, a symmetric MaxViT block–based decoder and upsampling layers are employed. To address the feature mismatches in the skip connections of UNet architecture, we introduce convolutional block attention module (CBAM). Furthermore, we design a multi‐scale convolutional block attention module (MCBAM) based on CBAM, which utilises multi‐scale features to enhance feature representation and refine the skip connection. We evaluate the segmentation performance of MSA‐MaxNet on three publicly available medical imaging datasets, including Synapse for multi‐organ segmentation, ACDC for cardiac analysis and Kvasir‐SEG for gastrointestinal polyp detection. Notably, MSA‐MaxNet achieves state‐of‐the‐art (SOTA) Dice scores of 85.59% and 95.26% on Synapse and Kvasir‐SEG datasets, respectively, with 40.28 M parameters. Additionally, we introduce two smaller versions of MSA‐MaxNet to meet the demands of various scenarios. In summary, our work provides a robust framework for diverse medical imaging tasks, offering potential applications in early cancer detection, cardiovascular disease diagnosis and comprehensive organ‐level assessments.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Neural Networks, ComputerImage Processing, Computer-AssistedHumansAlgorithmsDiagnostic Imaging

Stichwörter der Autor:innen

CNNmedical image segmentationmulti‐scalepathological changesself‐attention

Autor:innen und Institutionen

  • School of Computer Science and Software Engineering, University of Science and Technology Liaoning, Anshan, China.
  • School of AI and Advanced Computing, XJTLU Entrepreneur College (Taicang), Xi'an Jiaotong-Liverpool University, Suzhou, China.
  • School of Electronic and Information Engineering, University of Science and Technology Liaoning, Anshan, China.
  • Wenzhou Institute, University of Chinese Academy of Sciences, Wenzhou, China.

ORCID-Profile: Qi Zhao

Förderung

  • Natural Science Foundation of Liaoning Province
  • Fundamental Research Funds for the Liaoning Universities

Zitieren

APA

Wu, W., Huang, J., Zhang, M., Li, Y., Yu, Q., & Zhao, Q. (2024). MSA ‐ MaxNet : Multi‐Scale Attention Enhanced Multi‐Axis Vision Transformer Network for Medical Image Segmentation. Journal of Cellular and Molecular Medicine, 28(24). https://doi.org/10.1111/jcmm.70315

Vancouver

Wu W, Huang J, Zhang M, Li Y, Yu Q, Zhao Q. MSA ‐ MaxNet : Multi‐Scale Attention Enhanced Multi‐Axis Vision Transformer Network for Medical Image Segmentation. Journal of Cellular and Molecular Medicine. 2024;28(24). doi:10.1111/jcmm.70315

BibTeX
@article{Wu2024,
  author = {Wu, Wei and Huang, Junfeng and Zhang, Mingxuan and Li, Yichen and Yu, Qijia and Zhao, Qi},
  title = {MSA ‐ MaxNet : Multi‐Scale Attention Enhanced Multi‐Axis Vision Transformer Network for Medical Image Segmentation},
  journal = {Journal of Cellular and Molecular Medicine},
  year = {2024},
  volume = {28},
  number = {24},
  doi = {10.1111/jcmm.70315}
}
Kostenlos starten →