EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

Hybrid attention mechanism of feature fusion for medical image segmentation

Shanshan Tong, Zhentao Zuo, Zuxiang Liu, Dengdi Sun, Tiangang Zhou

IET Image Processing · 2024-01 · 18 (1) · 77-87

DOI: 10.1049/ipr2.12934 ↗

At a glance

Journal article in IET Image Processing, published online on 2023-09-28. Written by Shanshan Tong and 4 co-authors. Cited 16 times so far (Crossref); 41 references. The full text is freely available (open access, CC BY 4.0). Funded by: Youth Innovation Promotion Association of the Chinese Academy of Sciences.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Traditional convolution neural networks (CNN) have achieved good performance in multi‐organ segmentation of medical images. Due to the lack of ability to model long‐range dependencies and correlations between image pixels, CNN usually ignores the information of channel dimension. To further improve the performance of multi‐organ segmentation, a hybrid attention mechanism model is proposed. First, a CNN was used to extract multi‐scale feature maps and fed into the Channel Attention Enhancement Module (CAEM) to selectively pay attention to target organs in medical images, and the Transformer encoded tokenized image patches from CNN feature maps as the input sequence to model long‐range dependencies. Second, the decoder upsampled the output from Transformer and fused with the CAEM features in multi‐scale through skip connections. Finally, we introduced a Refinement Module (RM) after the decoder to improve feature correlations of the same organ and the feature discriminability between different organs. The model outperformed on dice coefficient (%) and hd95 on both the synapse multi‐organ segmentation and cardiac diagnosis challenge datasets. The hybrid attention mechanisms exhibited high efficiency and high segmentation accuracy in medical images.

Funding

  • Youth Innovation Promotion Association of the Chinese Academy of Sciences

Cite

APA

Tong, S., Zuo, Z., Liu, Z., Sun, D., & Zhou, T. (2024). Hybrid attention mechanism of feature fusion for medical image segmentation. IET Image Processing, 18(1), 77-87. https://doi.org/10.1049/ipr2.12934

Vancouver

Tong S, Zuo Z, Liu Z, Sun D, Zhou T. Hybrid attention mechanism of feature fusion for medical image segmentation. IET Image Processing. 2024;18(1):77-87. doi:10.1049/ipr2.12934

BibTeX
@article{Tong2024,
  author = {Tong, Shanshan and Zuo, Zhentao and Liu, Zuxiang and Sun, Dengdi and Zhou, Tiangang},
  title = {Hybrid attention mechanism of feature fusion for medical image segmentation},
  journal = {IET Image Processing},
  year = {2024},
  volume = {18},
  number = {1},
  pages = {77--87},
  doi = {10.1049/ipr2.12934}
}
Start for free →