MOTC: Abdominal Multi-objective Segmentation Model with Parallel Fusion of Global and Local Information
Journal of Imaging Informatics in Medicine · 2024
DOI: 10.1007/s10278-024-00978-2 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Imaging Informatics in Medicine, 2024. Verfasst von GuoDong Zhang und 7 weiteren Autor:innen. Beteiligte Einrichtung: School of Computer, Shenyang Aerospace University, Daoyi South Street, Shenyang, 110135, Liaoning Province, China. Hauptthemen laut MEDLINE: Neural Networks, Computer. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: National Natural Science Foundation of China, National Natural Science Foundation of Liaoning, Aviation Science Foundation.
Abstract (Originalsprache)
Convolutional Neural Networks have been widely applied in medical image segmentation. However, the existence of local inductive bias in convolutional operations restricts the modeling of long-term dependencies. The introduction of Transformer enables the modeling of long-term dependencies and partially eliminates the local inductive bias in convolutional operations, thereby improving the accuracy of tasks such as segmentation and classification. Researchers have proposed various hybrid structures combining Transformer and Convolutional Neural Networks. One strategy is to stack Transformer blocks and convolutional blocks to concentrate on eliminating the accumulated local bias of convolutional operations. Another strategy is to nest convolutional blocks and Transformer blocks to eliminate bias within each nested block. However, due to the granularity of bias elimination operations, these two strategies cannot fully exploit the potential of Transformer. In this paper, a parallel hybrid model is proposed for segmentation, which includes a Transformer branch and a Convolutional Neural Network branch in encoder. After parallel feature extraction, inter-layer information fusion and exchange of complementary information are performed between the two branches, simultaneously extracting local and global features while eliminating the local bias generated by convolutional operations within the current layer. A pure convolutional operation is used in decoder to obtain final segmentation results. To validate the impact of the granularity of bias elimination operations on the effectiveness of local bias elimination, the experiments in this paper were conducted on Flare21 dataset and Amos22 dataset. The average Dice coefficient reached 92.65% on Flare21 dataset, and 91.61% on Amos22 dataset, surpassing comparative methods. The experimental results demonstrate that smaller granularity of bias elimination operations leads to better performance.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Computer, Shenyang Aerospace University, Daoyi South Street, Shenyang, 110135, Liaoning Province, China.
- Key Laboratory of Intelligent Computing in Medical Image, Northeastern University, Wenhua Street, Shenyang, 110819, Liaoning Province, China.
- School of Computer, Shenyang Aerospace University, Daoyi South Street, Shenyang, 110135, Liaoning Province, China. rhj_sau@163.com.
- Department of Radiology, The Peoples Hospital of Liaoning Province, Wenyi Street, Shenyang, 110016, Liaoning Province, China. rhj_sau@163.com.
Förderung
- National Natural Science Foundation of China
- National Natural Science Foundation of Liaoning
- Aviation Science Foundation
Zitieren
APA
Zhang, G., Gu, W., Wang, S., Li, Y., Zhao, D., Liang, T., Gong, Z., & Ju, R. (2024). MOTC: Abdominal Multi-objective Segmentation Model with Parallel Fusion of Global and Local Information. Journal of Imaging Informatics in Medicine. https://doi.org/10.1007/s10278-024-00978-2
Vancouver
Zhang G, Gu W, Wang S, Li Y, Zhao D, Liang T, et al. MOTC: Abdominal Multi-objective Segmentation Model with Parallel Fusion of Global and Local Information. Journal of Imaging Informatics in Medicine. 2024. doi:10.1007/s10278-024-00978-2
BibTeX
@article{Zhang2024,
author = {Zhang, GuoDong and Gu, WenWen and Wang, SuRan and Li, YanLin and Zhao, DaZhe and Liang, TingYu and Gong, ZhaoXuan and Ju, RongHui},
title = {MOTC: Abdominal Multi-objective Segmentation Model with Parallel Fusion of Global and Local Information},
journal = {Journal of Imaging Informatics in Medicine},
year = {2024},
doi = {10.1007/s10278-024-00978-2}
}
EUVIMED