CLIP2Pose: Frozen CLIP as Semantic Guide for Domain Adaptive Pose Estimation
Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (8) · 6208-6216
DOI: 10.1609/aaai.v40i8.37546 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Jiawen Li und 4 weiteren Autor:innen.
Abstract (Originalsprache)
Unsupervised domain adaptive pose estimation is a fundamental yet challenging task due to the need to transfer from labeled synthetic data to unlabeled real data. Nevertheless, the underlying pose semantics, which are governed by spatial structure, remain largely consistent across domains. This observation motivates the use of vision-language models, which provide domain-invariant representations that align well with high-level semantic concepts. Motivated by this, we propose CLIP2Pose, a novel framework that leverages the semantic robustness of frozen CLIP encoders to facilitate cross-domain generalization. We first introduce a semantic-driven prompt mechanism that encodes structural priors, domain-specific appearance, and instance-level context into the image representation. This guides the model to focus on semantically meaningful and structurally relevant features. Next, we propose a semantic modulation module that adaptively refines visual features by conditioning them on prompt-derived embeddings, enhancing alignment between semantics and visual patterns. To further bridge the modality and domain gaps, we design a directional alignment loss that encourages consistent structural reasoning across both vision and language representations. Extensive experiments on domain adaptive human body and hand pose benchmarks show that CLIP2Pose achieves state-of-the-art performance.
Zitieren
APA
Li, J., Jiang, F., Zhu, D., Shi, J., & Zhou, A. (2026). CLIP2Pose: Frozen CLIP as Semantic Guide for Domain Adaptive Pose Estimation. Proceedings of the AAAI Conference on Artificial Intelligence, 40(8), 6208-6216. https://doi.org/10.1609/aaai.v40i8.37546
Vancouver
Li J, Jiang F, Zhu D, Shi J, Zhou A. CLIP2Pose: Frozen CLIP as Semantic Guide for Domain Adaptive Pose Estimation. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(8):6208-6216. doi:10.1609/aaai.v40i8.37546
BibTeX
@article{Li2026,
author = {Li, Jiawen and Jiang, Fei and Zhu, Dandan and Shi, Jinxin and Zhou, Aimin},
title = {CLIP2Pose: Frozen CLIP as Semantic Guide for Domain Adaptive Pose Estimation},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2026},
volume = {40},
number = {8},
pages = {6208--6216},
doi = {10.1609/aaai.v40i8.37546}
}
EUVIMED