Spatio-Temporal Dynamic Attention Graph Convolutional Network Based on Skeleton Gesture Recognition
Electronics · 2024-09-20 · 13 (18) · 3733
DOI: 10.3390/electronics13183733 ↗At a glance
Journal article in Electronics, published online on 2024-09-20. Written by Xiaowei Han and 4 co-authors. Cited 19 times so far (Crossref); 32 references. The full text is freely available (open access, CC BY 4.0). Funded by: Heilongjiang Postdoctoral Fund to pursue scientific research in Heilongjiang Province.
Abstract (original language)
Dynamic gesture recognition based on skeletal data has garnered significant attention with the rise of graph convolutional networks (GCNs). Existing methods typically calculate dependencies between joints and utilize spatio-temporal attention features. However, they often rely on joint topological features of limited spatial extent and short-time features, making it challenging to extract intra-frame spatial features and long-term inter-frame temporal features. To address this, we propose a new GCN architecture for dynamic hand gesture recognition, called a spatio-temporal dynamic attention graph convolutional network (STDA-GCN). This model employs dynamic attention spatial graph convolution, enhancing spatial feature extraction capabilities while reducing computational complexity through improved cross-channel information interaction. Additionally, a salient location channel attention mechanism is integrated between spatio-temporal convolutions to extract useful spatial features and avoid redundancy. Finally, dynamic multi-scale temporal convolution is used to extract richer inter-frame gesture features, effectively capturing information across various time scales. Evaluations on the SHREC’17 Track and DHG-14/28 benchmark datasets show that our model achieves 97.14% and 95.84% accuracy, respectively. These results demonstrate the superior performance of STDA-GCN in dynamic gesture recognition tasks.
Funding
- Heilongjiang Postdoctoral Fund to pursue scientific research in Heilongjiang Province
Cite
APA
Han, X., Cui, Y., Chen, X., Lu, Y., & Hu, W. (2024). Spatio-Temporal Dynamic Attention Graph Convolutional Network Based on Skeleton Gesture Recognition. Electronics, 13(18), 3733. https://doi.org/10.3390/electronics13183733
Vancouver
Han X, Cui Y, Chen X, Lu Y, Hu W. Spatio-Temporal Dynamic Attention Graph Convolutional Network Based on Skeleton Gesture Recognition. Electronics. 2024;13(18):3733. doi:10.3390/electronics13183733
BibTeX
@article{Han2024,
author = {Han, Xiaowei and Cui, Ying and Chen, Xingyu and Lu, Yunjing and Hu, Wen},
title = {Spatio-Temporal Dynamic Attention Graph Convolutional Network Based on Skeleton Gesture Recognition},
journal = {Electronics},
year = {2024},
volume = {13},
number = {18},
pages = {3733},
doi = {10.3390/electronics13183733}
}
EUVIMED