Enhancing Robust Category‐Agnostic Pose Estimation through Multi‐Modal Feature Alignment
Computer Graphics Forum · 30.03.2026
DOI: 10.1111/cgf.70368 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computer Graphics Forum, online erschienen am 30.03.2026. Verfasst von Boxuan Li und 1 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 34 Literaturangaben. Gefördert von: Natural Science Foundation of Xiamen Municipality.
Abstract (Originalsprache)
Category‐Agnostic Pose Estimation (CAPE) aims to detect keypoints for objects of any category using only a few labeled samples, making it a challenging yet crucial task for general‐purpose visual understanding. Existing methods rely on either visual or textual inputs, but the lack of cross‐modal interaction limits generalization. Without a unified input representation, solely using visual features hinders consistent prediction of same‐type keypoints, while fixed textual representations fail to capture the diverse characteristics of same‐type keypoints, leading to coarse and over‐generalized outputs. To address these limitations, we propose two multi‐modal frameworks that perform visual‐textual integration at both the feature and decision levels. Our feature‐level module leverages cross‐modal attention to align and enhance keypoint representations, while the decision‐level fusion adaptively combines modality‐specific predictions through a modality‐consistency loss. Experiments on the large‐scale MP‐100 dataset demonstrate that our method surpasses existing baselines in both accuracy and robustness. Under the challenging 1‐shot setting, our model achieves a 0.58% improvement in PCK0.2 over the state‐of‐the‐art CAPE method.
Förderung
- Natural Science Foundation of Xiamen Municipality
Zitieren
APA
Li, B., & Liu, J. (2026). Enhancing Robust Category‐Agnostic Pose Estimation through Multi‐Modal Feature Alignment. Computer Graphics Forum. https://doi.org/10.1111/cgf.70368
Vancouver
Li B, Liu J. Enhancing Robust Category‐Agnostic Pose Estimation through Multi‐Modal Feature Alignment. Computer Graphics Forum. 2026. doi:10.1111/cgf.70368
BibTeX
@article{Li2026,
author = {Li, Boxuan and Liu, Juan},
title = {Enhancing Robust Category‐Agnostic Pose Estimation through Multi‐Modal Feature Alignment},
journal = {Computer Graphics Forum},
year = {2026},
doi = {10.1111/cgf.70368}
}
EUVIMED