Combinatorial CNN-Transformer Learning with Manifold Constraints for Semi-supervised Medical Image Segmentation
Proceedings of the AAAI Conference on Artificial Intelligence · 24.03.2024 · 38 (3) · 2330-2338
DOI: 10.1609/aaai.v38i3.28007 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 24.03.2024. Verfasst von Huimin Huang und 7 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref).
Abstract (Originalsprache)
Semi-supervised learning (SSL), as one of the dominant methods, aims at leveraging the unlabeled data to deal with the annotation dilemma of supervised learning, which has attracted much attentions in the medical image segmentation. Most of the existing approaches leverage a unitary network by convolutional neural networks (CNNs) with compulsory consistency of the predictions through small perturbations applied to inputs or models. The penalties of such a learning paradigm are that (1) CNN-based models place severe limitations on global learning; (2) rich and diverse class-level distributions are inhibited. In this paper, we present a novel CNN-Transformer learning framework in the manifold space for semi-supervised medical image segmentation. First, at intra-student level, we propose a novel class-wise consistency loss to facilitate the learning of both discriminative and compact target feature representations. Then, at inter-student level, we align the CNN and Transformer features using a prototype-based optimal transport method. Extensive experiments show that our method outperforms previous state-of-the-art methods on three public medical image segmentation benchmarks.
Zitieren
APA
Huang, H., Huang, Y., Xie, S., Lin, L., Tong, R., Chen, Y., Li, Y., & Zheng, Y. (2024). Combinatorial CNN-Transformer Learning with Manifold Constraints for Semi-supervised Medical Image Segmentation. Proceedings of the AAAI Conference on Artificial Intelligence, 38(3), 2330-2338. https://doi.org/10.1609/aaai.v38i3.28007
Vancouver
Huang H, Huang Y, Xie S, Lin L, Tong R, Chen Y, et al. Combinatorial CNN-Transformer Learning with Manifold Constraints for Semi-supervised Medical Image Segmentation. Proceedings of the AAAI Conference on Artificial Intelligence. 2024;38(3):2330-2338. doi:10.1609/aaai.v38i3.28007
BibTeX
@article{Huang2024,
author = {Huang, Huimin and Huang, Yawen and Xie, Shiao and Lin, Lanfen and Tong, Ruofeng and Chen, Yen-Wei and Li, Yuexiang and Zheng, Yefeng},
title = {Combinatorial CNN-Transformer Learning with Manifold Constraints for Semi-supervised Medical Image Segmentation},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2024},
volume = {38},
number = {3},
pages = {2330--2338},
doi = {10.1609/aaai.v38i3.28007}
}
EUVIMED