Dual‐branch Transformer for semi‐supervised medical image segmentation
Journal of Applied Clinical Medical Physics · 2024
DOI: 10.1002/acm2.14483 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Applied Clinical Medical Physics, 2024. Verfasst von Xiaojie Huang und 6 weiteren Autor:innen. Beteiligte Einrichtung: The Second Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, China. Hauptthemen laut MEDLINE: Image Processing, Computer-Assisted, Neural Networks, Computer, Deep Learning. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 54 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Purpose
In recent years, the use of deep learning for medical image segmentation has become a popular trend, but its development also faces some challenges. Firstly, due to the specialized nature of medical data, precise annotation is time‐consuming and labor‐intensive. Training neural networks effectively with limited labeled data is a significant challenge in medical image analysis. Secondly, convolutional neural networks commonly used for medical image segmentation research often focus on local features in images. However, the recognition of complex anatomical structures or irregular lesions often requires the assistance of both local and global information, which has led to a bottleneck in its development. Addressing these two issues, in this paper, we propose a novel network architecture.
Methods
We integrate a shift window mechanism to learn more comprehensive semantic information and employ a semi‐supervised learning strategy by incorporating a flexible amount of unlabeled data. Specifically, a typical U‐shaped encoder‐decoder structure is applied to obtain rich feature maps. Each encoder is designed as a dual‐branch structure, containing Swin modules equipped with windows of different size to capture features of multiple scales. To effectively utilize unlabeled data, a level set function is introduced to establish consistency between the function regression and pixel classification.
Results
We conducted experiments on the COVID‐19 CT dataset and DRIVE dataset and compared our approach with various semi‐supervised and fully supervised learning models. On the COVID‐19 CT dataset, we achieved a segmentation accuracy of up to 74.56%. Our segmentation accuracy on the DRIVE dataset was 79.79%.
Conclusions
The results demonstrate the outstanding performance of our method on several commonly used evaluation metrics. The high segmentation accuracy of our model demonstrates that utilizing Swin modules with different window sizes can enhance the feature extraction capability of the model, and the level set function can enable semi‐supervised models to more effectively utilize unlabeled data. This provides meaningful insights for the application of deep learning in medical image segmentation. Our code will be released once the manuscript is accepted for publication.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- The Second Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, China.
- Zhejiang University of Technology, Hangzhou, China.
- Stomatology Hospital, School of Stomatology, Zhejiang University School of Medicine, Hangzhou, China.
Zitieren
APA
Huang, X., Zhu, Y., Shao, M., Xia, M., Shen, X., Wang, P., & Wang, X. (2024). Dual‐branch Transformer for semi‐supervised medical image segmentation. Journal of Applied Clinical Medical Physics. https://doi.org/10.1002/acm2.14483
Vancouver
Huang X, Zhu Y, Shao M, Xia M, Shen X, Wang P, et al. Dual‐branch Transformer for semi‐supervised medical image segmentation. Journal of Applied Clinical Medical Physics. 2024. doi:10.1002/acm2.14483
BibTeX
@article{Huang2024,
author = {Huang, Xiaojie and Zhu, Yating and Shao, Minghan and Xia, Ming and Shen, Xiaoting and Wang, Pingli and Wang, Xiaoyan},
title = {Dual‐branch Transformer for semi‐supervised medical image segmentation},
journal = {Journal of Applied Clinical Medical Physics},
year = {2024},
doi = {10.1002/acm2.14483}
}
EUVIMED