Dual Dynamic Consistency Regularization for Semi-Supervised Domain Adaptation
IEEE Access · 2024 · 12 · 36267-36279
DOI: 10.1109/access.2024.3374105 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Access, 2024. Verfasst von Ba Hung Ngo und 4 weiteren Autor:innen. Die Arbeit wurde bisher 35-mal zitiert (Crossref) und nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Research Foundation of Korea, Korea Government.
Abstract (Originalsprache)
The Vision Transformer (ViT) model serves as a powerful model to capture and comprehend global information, particularly when trained on extensive datasets. Conversely, the Convolutional Neural Network (CNN) model is beneficial to training with small datasets for retaining essential local information. Inspired by these properties of ViT and CNN models, we introduce a hybrid framework that smoothly increases the cross-domain generalization in Semi-supervised Domain Adaptation (SSDA). To achieve this goal, we first train the ViT model on abundant labeled source data, while the CNN model is trained on a few labeled target samples. Then, these models dynamically exchange their knowledge for potential generalization to unlabeled target data via the proposed method, named Dual Dynamic Consistency Regularization (D2CR). Specifically, the ViT model provides its pseudo labels to update the global perspective for the CNN model. Similarly, the CNN model offers pseudo labels to complement the local perspective for the ViT model. The previous methods use a fixed threshold algorithm for the pseudo-labeling process. However, we utilize the dynamic threshold strategy to create pseudo labels for the bi-directional consistency regularization learning between the ViT and CNN models. We verify our approach across several SSDA benchmark datasets. The outstanding experimental results provide strong evidence of the effectiveness and superiority of our approach over previous state-of-the-art SSDA methods.
Förderung
- National Research Foundation of Korea
- Korea Government
Zitieren
APA
Ngo, B. H., Lam, B. T., Nguyen, T. H., Dinh, Q. V., & Choi, T. J. (2024). Dual Dynamic Consistency Regularization for Semi-Supervised Domain Adaptation. IEEE Access, 12, 36267-36279. https://doi.org/10.1109/access.2024.3374105
Vancouver
Ngo BH, Lam BT, Nguyen TH, Dinh QV, Choi TJ. Dual Dynamic Consistency Regularization for Semi-Supervised Domain Adaptation. IEEE Access. 2024;12:36267-36279. doi:10.1109/access.2024.3374105
BibTeX
@article{Ngo2024,
author = {Ngo, Ba Hung and Lam, Ba Thinh and Nguyen, Thanh Huy and Dinh, Quang Vinh and Choi, Tae Jong},
title = {Dual Dynamic Consistency Regularization for Semi-Supervised Domain Adaptation},
journal = {IEEE Access},
year = {2024},
volume = {12},
pages = {36267--36279},
doi = {10.1109/access.2024.3374105}
}
EUVIMED