EUVIMEDEUVIMED entdecken
Crossref

SCD-Net: Spatiotemporal Clues Disentanglement Network for Self-Supervised Skeleton-Based Action Recognition

Cong Wu, Xiao-Jun Wu, Josef Kittler, Tianyang Xu, Sara Ahmed, Muhammad Awais, Zhenhua Feng

Proceedings of the AAAI Conference on Artificial Intelligence · 24.03.2024 · 38 (6) · 5949-5957

DOI: 10.1609/aaai.v38i6.28409 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 24.03.2024. Verfasst von Cong Wu und 6 weiteren Autor:innen. Die Arbeit wurde bisher 29-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Contrastive learning has achieved great success in skeleton-based action recognition. However, most existing approaches encode the skeleton sequences as entangled spatiotemporal representations and confine the contrasts to the same level of representation. Instead, this paper introduces a novel contrastive learning framework, namely Spatiotemporal Clues Disentanglement Network (SCD-Net). Specifically, we integrate the decoupling module with a feature extractor to derive explicit clues from spatial and temporal domains respectively. As for the training of SCD-Net, with a constructed global anchor, we encourage the interaction between the anchor and extracted clues. Further, we propose a new masking strategy with structural constraints to strengthen the contextual associations, leveraging the latest development from masked image modelling into the proposed SCD-Net. We conduct extensive evaluations on the NTU-RGB+D (60&120) and PKU-MMD (I&II) datasets, covering various downstream tasks such as action recognition, action retrieval, transfer learning, and semi-supervised learning. The experimental results demonstrate the effectiveness of our method, which outperforms the existing state-of-the-art (SOTA) approaches significantly. Our code and supplementary material can be found at https://github.com/cong-wu/SCD-Net.

Zitieren

APA

Wu, C., Wu, X., Kittler, J., Xu, T., Ahmed, S., Awais, M., & Feng, Z. (2024). SCD-Net: Spatiotemporal Clues Disentanglement Network for Self-Supervised Skeleton-Based Action Recognition. Proceedings of the AAAI Conference on Artificial Intelligence, 38(6), 5949-5957. https://doi.org/10.1609/aaai.v38i6.28409

Vancouver

Wu C, Wu X, Kittler J, Xu T, Ahmed S, Awais M, et al. SCD-Net: Spatiotemporal Clues Disentanglement Network for Self-Supervised Skeleton-Based Action Recognition. Proceedings of the AAAI Conference on Artificial Intelligence. 2024;38(6):5949-5957. doi:10.1609/aaai.v38i6.28409

BibTeX
@article{Wu2024,
  author = {Wu, Cong and Wu, Xiao-Jun and Kittler, Josef and Xu, Tianyang and Ahmed, Sara and Awais, Muhammad and Feng, Zhenhua},
  title = {SCD-Net: Spatiotemporal Clues Disentanglement Network for Self-Supervised Skeleton-Based Action Recognition},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2024},
  volume = {38},
  number = {6},
  pages = {5949--5957},
  doi = {10.1609/aaai.v38i6.28409}
}
Kostenlos starten →