Hybrid attention mechanism of feature fusion for medical image segmentation
IET Image Processing · 2024-01 · 18 (1) · 77-87
DOI: 10.1049/ipr2.12934 ↗Kurz gefasst
Fachartikel in der Zeitschrift IET Image Processing, online erschienen am 28.09.2023. Verfasst von Shanshan Tong und 4 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Youth Innovation Promotion Association of the Chinese Academy of Sciences.
Abstract (Originalsprache)
Traditional convolution neural networks (CNN) have achieved good performance in multi‐organ segmentation of medical images. Due to the lack of ability to model long‐range dependencies and correlations between image pixels, CNN usually ignores the information of channel dimension. To further improve the performance of multi‐organ segmentation, a hybrid attention mechanism model is proposed. First, a CNN was used to extract multi‐scale feature maps and fed into the Channel Attention Enhancement Module (CAEM) to selectively pay attention to target organs in medical images, and the Transformer encoded tokenized image patches from CNN feature maps as the input sequence to model long‐range dependencies. Second, the decoder upsampled the output from Transformer and fused with the CAEM features in multi‐scale through skip connections. Finally, we introduced a Refinement Module (RM) after the decoder to improve feature correlations of the same organ and the feature discriminability between different organs. The model outperformed on dice coefficient (%) and hd95 on both the synapse multi‐organ segmentation and cardiac diagnosis challenge datasets. The hybrid attention mechanisms exhibited high efficiency and high segmentation accuracy in medical images.
Förderung
- Youth Innovation Promotion Association of the Chinese Academy of Sciences
Zitieren
APA
Tong, S., Zuo, Z., Liu, Z., Sun, D., & Zhou, T. (2024). Hybrid attention mechanism of feature fusion for medical image segmentation. IET Image Processing, 18(1), 77-87. https://doi.org/10.1049/ipr2.12934
Vancouver
Tong S, Zuo Z, Liu Z, Sun D, Zhou T. Hybrid attention mechanism of feature fusion for medical image segmentation. IET Image Processing. 2024;18(1):77-87. doi:10.1049/ipr2.12934
BibTeX
@article{Tong2024,
author = {Tong, Shanshan and Zuo, Zhentao and Liu, Zuxiang and Sun, Dengdi and Zhou, Tiangang},
title = {Hybrid attention mechanism of feature fusion for medical image segmentation},
journal = {IET Image Processing},
year = {2024},
volume = {18},
number = {1},
pages = {77--87},
doi = {10.1049/ipr2.12934}
}
EUVIMED