Multistage Spatial Attention-Based Neural Network for Hand Gesture Recognition
Computers · 05.01.2023 · 12 (1) · 13
DOI: 10.3390/computers12010013 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computers, online erschienen am 05.01.2023. Verfasst von Abu Saleh Musa Miah und 4 weiteren Autor:innen. Die Arbeit wurde bisher 63-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Competitive Research Fund of The University of Aizu, Japan.
Abstract (Originalsprache)
The definition of human-computer interaction (HCI) has changed in the current year because people are interested in their various ergonomic devices ways. Many researchers have been working to develop a hand gesture recognition system with a kinetic sensor-based dataset, but their performance accuracy is not satisfactory. In our work, we proposed a multistage spatial attention-based neural network for hand gesture recognition to overcome the challenges. We included three stages in the proposed model where each stage is inherited the CNN; where we first apply a feature extractor and a spatial attention module by using self-attention from the original dataset and then multiply the feature vector with the attention map to highlight effective features of the dataset. Then, we explored features concatenated with the original dataset for obtaining modality feature embedding. In the same way, we generated a feature vector and attention map in the second stage with the feature extraction architecture and self-attention technique. After multiplying the attention map and features, we produced the final feature, which feeds into the third stage, a classification module to predict the label of the correspondent hand gesture. Our model achieved 99.67%, 99.75%, and 99.46% accuracy for the senz3D, Kinematic, and NTU datasets.
Förderung
- Competitive Research Fund of The University of Aizu, Japan
Zitieren
APA
Miah, A. S. M., Hasan, M. A. M., Shin, J., Okuyama, Y., & Tomioka, Y. (2023). Multistage Spatial Attention-Based Neural Network for Hand Gesture Recognition. Computers, 12(1), 13. https://doi.org/10.3390/computers12010013
Vancouver
Miah ASM, Hasan MAM, Shin J, Okuyama Y, Tomioka Y. Multistage Spatial Attention-Based Neural Network for Hand Gesture Recognition. Computers. 2023;12(1):13. doi:10.3390/computers12010013
BibTeX
@article{Miah2023,
author = {Miah, Abu Saleh Musa and Hasan, Md. Al Mehedi and Shin, Jungpil and Okuyama, Yuichi and Tomioka, Yoichi},
title = {Multistage Spatial Attention-Based Neural Network for Hand Gesture Recognition},
journal = {Computers},
year = {2023},
volume = {12},
number = {1},
pages = {13},
doi = {10.3390/computers12010013}
}
EUVIMED