EUVIMEDEUVIMED entdecken
Crossref

HandMCM: Multi-modal Point Cloud-based Correspondence State Space Model for 3D Hand Pose Estimation

Wencan Cheng, Gim Hee Lee

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (5) · 3291-3299

DOI: 10.1609/aaai.v40i5.37324 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Wencan Cheng und 1 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

3D hand pose estimation that involves accurate estimation of 3D human hand keypoint locations is crucial for many human-computer interaction applications such as augmented reality. However, this task poses significant challenges due to self-occlusion of the hands and occlusions caused by interactions with objects. In this paper, we propose HandMCM to address these challenges. Our HandMCM is a novel method based on the powerful state space model (Mamba). By incorporating modules for local information injection/filtering and correspondence modeling, the proposed correspondence Mamba effectively learns the highly dynamic kinematic topology of keypoints across various occlusion scenarios. Moreover, by integrating multi-modal image features, we enhance the robustness and representational capacity of the input, leading to more accurate hand pose estimation. Empirical evaluations on three benchmark datasets demonstrate that our model significantly outperforms current state-of-the-art methods, particularly in challenging scenarios involving severe occlusions. These results highlight the potential of our approach to advance the accuracy and reliability of 3D hand pose estimation in practical applications.

Zitieren

APA

Cheng, W., & Lee, G. H. (2026). HandMCM: Multi-modal Point Cloud-based Correspondence State Space Model for 3D Hand Pose Estimation. Proceedings of the AAAI Conference on Artificial Intelligence, 40(5), 3291-3299. https://doi.org/10.1609/aaai.v40i5.37324

Vancouver

Cheng W, Lee GH. HandMCM: Multi-modal Point Cloud-based Correspondence State Space Model for 3D Hand Pose Estimation. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(5):3291-3299. doi:10.1609/aaai.v40i5.37324

BibTeX
@article{Cheng2026,
  author = {Cheng, Wencan and Lee, Gim Hee},
  title = {HandMCM: Multi-modal Point Cloud-based Correspondence State Space Model for 3D Hand Pose Estimation},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {5},
  pages = {3291--3299},
  doi = {10.1609/aaai.v40i5.37324}
}
Kostenlos starten →