EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Hybrid attention mechanism of feature fusion for medical image segmentation

Shanshan Tong, Zhentao Zuo, Zuxiang Liu, Dengdi Sun, Tiangang Zhou

IET Image Processing · 2024-01 · 18 (1) · 77-87

DOI: 10.1049/ipr2.12934 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IET Image Processing, online erschienen am 28.09.2023. Verfasst von Shanshan Tong und 4 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Youth Innovation Promotion Association of the Chinese Academy of Sciences.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Traditional convolution neural networks (CNN) have achieved good performance in multi‐organ segmentation of medical images. Due to the lack of ability to model long‐range dependencies and correlations between image pixels, CNN usually ignores the information of channel dimension. To further improve the performance of multi‐organ segmentation, a hybrid attention mechanism model is proposed. First, a CNN was used to extract multi‐scale feature maps and fed into the Channel Attention Enhancement Module (CAEM) to selectively pay attention to target organs in medical images, and the Transformer encoded tokenized image patches from CNN feature maps as the input sequence to model long‐range dependencies. Second, the decoder upsampled the output from Transformer and fused with the CAEM features in multi‐scale through skip connections. Finally, we introduced a Refinement Module (RM) after the decoder to improve feature correlations of the same organ and the feature discriminability between different organs. The model outperformed on dice coefficient (%) and hd95 on both the synapse multi‐organ segmentation and cardiac diagnosis challenge datasets. The hybrid attention mechanisms exhibited high efficiency and high segmentation accuracy in medical images.

Förderung

  • Youth Innovation Promotion Association of the Chinese Academy of Sciences

Zitieren

APA

Tong, S., Zuo, Z., Liu, Z., Sun, D., & Zhou, T. (2024). Hybrid attention mechanism of feature fusion for medical image segmentation. IET Image Processing, 18(1), 77-87. https://doi.org/10.1049/ipr2.12934

Vancouver

Tong S, Zuo Z, Liu Z, Sun D, Zhou T. Hybrid attention mechanism of feature fusion for medical image segmentation. IET Image Processing. 2024;18(1):77-87. doi:10.1049/ipr2.12934

BibTeX
@article{Tong2024,
  author = {Tong, Shanshan and Zuo, Zhentao and Liu, Zuxiang and Sun, Dengdi and Zhou, Tiangang},
  title = {Hybrid attention mechanism of feature fusion for medical image segmentation},
  journal = {IET Image Processing},
  year = {2024},
  volume = {18},
  number = {1},
  pages = {77--87},
  doi = {10.1049/ipr2.12934}
}
Kostenlos starten →