Multi‐scale nested UNet with transformer for colorectal polyp segmentation
Journal of Applied Clinical Medical Physics · 2024
DOI: 10.1002/acm2.14351 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Applied Clinical Medical Physics, 2024. Verfasst von Zenan Wang und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Gastroenterology, Beijing Chaoyang Hospital, the Third Clinical Medical College of Capital Medical University, Beijing, China. Hauptthemen laut MEDLINE: Colonic Polyps, Neural Networks, Computer, Colonoscopy. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
Polyp detection and localization are essential tasks for colonoscopy. U‐shape network based convolutional neural networks have achieved remarkable segmentation performance for biomedical images, but lack of long‐range dependencies modeling limits their receptive fields.
Purpose
Our goal was to develop and test a novel architecture for polyp segmentation, which takes advantage of learning local information with long‐range dependencies modeling.
Methods
A novel architecture combining with multi‐scale nested UNet structure integrated transformer for polyp segmentation was developed. The proposed network takes advantage of both CNN and transformer to extract distinct feature information. The transformer layer is embedded between the encoder and decoder of a U‐shape net to learn explicit global context and long‐range semantic information. To address the challenging of variant polyp sizes, a MSFF unit was proposed to fuse features with multiple resolution.
Results
Four public datasets and one in‐house dataset were used to train and test the model performance. Ablation study was also conducted to verify each component of the model. For dataset Kvasir‐SEG and CVC‐ClinicDB, the proposed model achieved mean dice score of 0.942 and 0.950 respectively, which were more accurate than the other methods. To show the generalization of different methods, we processed two cross dataset validations, the proposed model achieved the highest mean dice score. The results demonstrate that the proposed network has powerful learning and generalization capability, significantly improving segmentation accuracy and outperforming state‐of‐the‐art methods.
Conclusions
The proposed model produced more accurate polyp segmentation than current methods on four different public and one in‐house datasets. Its capability of polyps segmentation in different sizes shows the potential clinical application
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Gastroenterology, Beijing Chaoyang Hospital, the Third Clinical Medical College of Capital Medical University, Beijing, China.
- Hunan Key Laboratory of Nonferrous Resources and Geological Hazard Exploration, Changsha, China.
Zitieren
APA
Wang, Z., Liu, Z., Yu, J., Gao, Y., & Liu, M. (2024). Multi‐scale nested UNet with transformer for colorectal polyp segmentation. Journal of Applied Clinical Medical Physics. https://doi.org/10.1002/acm2.14351
Vancouver
Wang Z, Liu Z, Yu J, Gao Y, Liu M. Multi‐scale nested UNet with transformer for colorectal polyp segmentation. Journal of Applied Clinical Medical Physics. 2024. doi:10.1002/acm2.14351
BibTeX
@article{Wang2024,
author = {Wang, Zenan and Liu, Zhen and Yu, Jianfeng and Gao, Yingxin and Liu, Ming},
title = {Multi‐scale nested UNet with transformer for colorectal polyp segmentation},
journal = {Journal of Applied Clinical Medical Physics},
year = {2024},
doi = {10.1002/acm2.14351}
}
EUVIMED