EUVIMEDEUVIMED entdecken
Crossref

Enhancing Robust Category‐Agnostic Pose Estimation through Multi‐Modal Feature Alignment

Boxuan Li, Juan Liu

Computer Graphics Forum · 30.03.2026

DOI: 10.1111/cgf.70368 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computer Graphics Forum, online erschienen am 30.03.2026. Verfasst von Boxuan Li und 1 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 34 Literaturangaben. Gefördert von: Natural Science Foundation of Xiamen Municipality.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Category‐Agnostic Pose Estimation (CAPE) aims to detect keypoints for objects of any category using only a few labeled samples, making it a challenging yet crucial task for general‐purpose visual understanding. Existing methods rely on either visual or textual inputs, but the lack of cross‐modal interaction limits generalization. Without a unified input representation, solely using visual features hinders consistent prediction of same‐type keypoints, while fixed textual representations fail to capture the diverse characteristics of same‐type keypoints, leading to coarse and over‐generalized outputs. To address these limitations, we propose two multi‐modal frameworks that perform visual‐textual integration at both the feature and decision levels. Our feature‐level module leverages cross‐modal attention to align and enhance keypoint representations, while the decision‐level fusion adaptively combines modality‐specific predictions through a modality‐consistency loss. Experiments on the large‐scale MP‐100 dataset demonstrate that our method surpasses existing baselines in both accuracy and robustness. Under the challenging 1‐shot setting, our model achieves a 0.58% improvement in PCK0.2 over the state‐of‐the‐art CAPE method.

Förderung

  • Natural Science Foundation of Xiamen Municipality

Zitieren

APA

Li, B., & Liu, J. (2026). Enhancing Robust Category‐Agnostic Pose Estimation through Multi‐Modal Feature Alignment. Computer Graphics Forum. https://doi.org/10.1111/cgf.70368

Vancouver

Li B, Liu J. Enhancing Robust Category‐Agnostic Pose Estimation through Multi‐Modal Feature Alignment. Computer Graphics Forum. 2026. doi:10.1111/cgf.70368

BibTeX
@article{Li2026,
  author = {Li, Boxuan and Liu, Juan},
  title = {Enhancing Robust Category‐Agnostic Pose Estimation through Multi‐Modal Feature Alignment},
  journal = {Computer Graphics Forum},
  year = {2026},
  doi = {10.1111/cgf.70368}
}
Kostenlos starten →