EUVIMEDEUVIMED entdecken
Crossref

CLIP2Pose: Frozen CLIP as Semantic Guide for Domain Adaptive Pose Estimation

Jiawen Li, Fei Jiang, Dandan Zhu, Jinxin Shi, Aimin Zhou

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (8) · 6208-6216

DOI: 10.1609/aaai.v40i8.37546 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Jiawen Li und 4 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Unsupervised domain adaptive pose estimation is a fundamental yet challenging task due to the need to transfer from labeled synthetic data to unlabeled real data. Nevertheless, the underlying pose semantics, which are governed by spatial structure, remain largely consistent across domains. This observation motivates the use of vision-language models, which provide domain-invariant representations that align well with high-level semantic concepts. Motivated by this, we propose CLIP2Pose, a novel framework that leverages the semantic robustness of frozen CLIP encoders to facilitate cross-domain generalization. We first introduce a semantic-driven prompt mechanism that encodes structural priors, domain-specific appearance, and instance-level context into the image representation. This guides the model to focus on semantically meaningful and structurally relevant features. Next, we propose a semantic modulation module that adaptively refines visual features by conditioning them on prompt-derived embeddings, enhancing alignment between semantics and visual patterns. To further bridge the modality and domain gaps, we design a directional alignment loss that encourages consistent structural reasoning across both vision and language representations. Extensive experiments on domain adaptive human body and hand pose benchmarks show that CLIP2Pose achieves state-of-the-art performance.

Zitieren

APA

Li, J., Jiang, F., Zhu, D., Shi, J., & Zhou, A. (2026). CLIP2Pose: Frozen CLIP as Semantic Guide for Domain Adaptive Pose Estimation. Proceedings of the AAAI Conference on Artificial Intelligence, 40(8), 6208-6216. https://doi.org/10.1609/aaai.v40i8.37546

Vancouver

Li J, Jiang F, Zhu D, Shi J, Zhou A. CLIP2Pose: Frozen CLIP as Semantic Guide for Domain Adaptive Pose Estimation. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(8):6208-6216. doi:10.1609/aaai.v40i8.37546

BibTeX
@article{Li2026,
  author = {Li, Jiawen and Jiang, Fei and Zhu, Dandan and Shi, Jinxin and Zhou, Aimin},
  title = {CLIP2Pose: Frozen CLIP as Semantic Guide for Domain Adaptive Pose Estimation},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {8},
  pages = {6208--6216},
  doi = {10.1609/aaai.v40i8.37546}
}
Kostenlos starten →