Multiple Distilling-based spatial-temporal attention networks for unsupervised human action recognition
Intelligent Data Analysis · 17.07.2024 · 28 (4) · 921-941
DOI: 10.3233/ida-230399 ↗Kurz gefasst
Fachartikel in der Zeitschrift Intelligent Data Analysis, erschienen am 17.07.2024. Verfasst von Cheng Zhang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 47 Literaturangaben.
Abstract (Originalsprache)
Unsupervised action recognition based on spatiotemporal fusion feature extraction has attracted much attention in recent years. However, existing methods still have several limitations: (1) The long-term dependence relationship is not effectively extracted at the time level. (2) The high-order motion relationship between non-adjacent nodes is not effectively captured at the spatial level. (3) The model complexity is too high when the cascade layer input sequence is long, or there are many key points. To solve these problems, a Multiple Distilling-based spatial-temporal attention (MD-STA) networks is proposed in this paper. This model can extract temporal and spatial features respectively and fuse them. Specifically, we first propose a Screening Self-attention (SSA) module; this module can find long-term dependencies in distant frames and high-order motion patterns between non-adjacent nodes in a single frame through a sparse metric on dot product pairs. Then, we propose the Frames and Keypoint-Distilling (FKD) module, which uses extraction operations to halve the input of the cascade layer to eliminate invalid key points and time frame features, thus reducing time and memory complexity. Finally, the Dim-reduction Fusion (DRF) module is proposed to reduce the dimension of existing features to further eliminate redundancy. Numerous experiments were conducted on three distinct datasets: NTU-60, NTU-120, and UWA3D, showing that MD-STA achieves state-of-the-art standards in skeleton-based unsupervised action recognition.
Zitieren
APA
Zhang, C., Zhong, J., Cao, W., & Ji, J. (2024). Multiple Distilling-based spatial-temporal attention networks for unsupervised human action recognition. Intelligent Data Analysis, 28(4), 921-941. https://doi.org/10.3233/ida-230399
Vancouver
Zhang C, Zhong J, Cao W, Ji J. Multiple Distilling-based spatial-temporal attention networks for unsupervised human action recognition. Intelligent Data Analysis. 2024;28(4):921-941. doi:10.3233/ida-230399
BibTeX
@article{Zhang2024,
author = {Zhang, Cheng and Zhong, Jianqi and Cao, Wenming and Ji, Jianhua},
title = {Multiple Distilling-based spatial-temporal attention networks for unsupervised human action recognition},
journal = {Intelligent Data Analysis},
year = {2024},
volume = {28},
number = {4},
pages = {921--941},
doi = {10.3233/ida-230399}
}
EUVIMED