H2Former: An Efficient Hierarchical Hybrid Transformer for Medical Image Segmentation
IEEE Transactions on Medical Imaging · 2023-09 · 42 (9) · 2763-2775
DOI: 10.1109/tmi.2023.3264513 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Medical Imaging, 2023-09. Verfasst von Along He und 5 weiteren Autor:innen. Hauptthemen laut MEDLINE: Diagnosis, Computer-Assisted, Neural Networks, Computer. Die Arbeit wurde bisher 423-mal zitiert (Crossref) und nennt 55 Literaturangaben. Gefördert von: National Natural Science Foundation, CAAI-Huawei MindSpore Open Fund, AISG Tech Challenge Fundin.
Abstract (Originalsprache)
Accurate medical image segmentation is of great significance for computer aided diagnosis. Although methods based on convolutional neural networks (CNNs) have achieved good results, it is weak to model the long-range dependencies, which is very important for segmentation task to build global context dependencies. The Transformers can establish long-range dependencies among pixels by self-attention, providing a supplement to the local convolution. In addition, multi-scale feature fusion and feature selection are crucial for medical image segmentation tasks, which is ignored by Transformers. However, it is challenging to directly apply self-attention to CNNs due to the quadratic computational complexity for high-resolution feature maps. Therefore, to integrate the merits of CNNs, multi-scale channel attention and Transformers, we propose an efficient hierarchical hybrid vision Transformer (H2Former) for medical image segmentation. With these merits, the model can be data-efficient for limited medical data regime. The experimental results show that our approach exceeds previous Transformer, CNNs and hybrid methods on three 2D and two 3D medical image segmentation tasks. Moreover, it keeps computational efficiency in model parameters, FLOPs and inference time. For example, H2Former outperforms TransUNet by 2.29% in IoU score on KVASIR-SEG dataset with 30.77% parameters and 59.23% FLOPs.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Förderung
- National Natural Science Foundation
- CAAI-Huawei MindSpore Open Fund
- AISG Tech Challenge Fundin
- A*STAR CDF
Zitieren
APA
He, A., Wang, K., Li, T., Du, C., Xia, S., & Fu, H. (2023). H2Former: An Efficient Hierarchical Hybrid Transformer for Medical Image Segmentation. IEEE Transactions on Medical Imaging, 42(9), 2763-2775. https://doi.org/10.1109/tmi.2023.3264513
Vancouver
He A, Wang K, Li T, Du C, Xia S, Fu H. H2Former: An Efficient Hierarchical Hybrid Transformer for Medical Image Segmentation. IEEE Transactions on Medical Imaging. 2023;42(9):2763-2775. doi:10.1109/tmi.2023.3264513
BibTeX
@article{He2023,
author = {He, Along and Wang, Kai and Li, Tao and Du, Chengkun and Xia, Shuang and Fu, Huazhu},
title = {H2Former: An Efficient Hierarchical Hybrid Transformer for Medical Image Segmentation},
journal = {IEEE Transactions on Medical Imaging},
year = {2023},
volume = {42},
number = {9},
pages = {2763--2775},
doi = {10.1109/tmi.2023.3264513}
}
EUVIMED