A feature-free deep learning approach for midair hand gesture recognition from surface electromyogram (sEMG) data
Turkish Journal of Electrical Engineering and Computer Sciences · 25.11.2025 · 33 (6) · 688-705
DOI: 10.55730/1300-0632.4152 ↗Kurz gefasst
Fachartikel in der Zeitschrift Turkish Journal of Electrical Engineering and Computer Sciences, online erschienen am 25.11.2025. Verfasst von YASIR ALTAF und 2 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Midair hand gesture recognition plays a crucial role in applications such as sign language recognition and human-computer interaction, particularly for supporting individuals with partial or complete hearing loss. However, recognizing gestures in midair remains challenging due to the rapid and complex nature of hand movements. To address this, noninvasive techniques like surface electromyography (sEMG)—which captures muscle activity through sensors placed on the skin—have gained attention. sEMG provides rich time-series data that reflect both spatial and temporal muscle dynamics. In this study, we propose a deep learning architecture that combines convolutional neural networks (CNNs) and recurrent neural networks (RNNs) to classify midair hand gestures directly from raw sEMG signals. The CNN extracts spatial features, while the RNN captures temporal dependencies, enabling the model to understand dynamic gestures effectively. An ablation study comparing raw signals, fast Fourier transform (FFT)-based features, and wavelet-based features on two public datasets—Arabic Sign Language (ArSL) EMG and AirScript—demonstrated that raw sEMG signals consistently yielded the highest performance, achieving 94.4% accuracy on the ArSL EMG dataset and 92.7% on AirScript. These results show that our model can accurately classify in-air gestures without the need for additional feature extraction, thereby reducing model complexity and computational overhead. Furthermore, transfer learning was employed to enhance generalization on the smaller AirScript dataset, achieving a boosted accuracy of 95.18%. Overall, the study confirms that direct use of raw sEMG signals with a CNN-RNN model is an effective and efficient solution for midair gesture recognition.
Zitieren
APA
ALTAF, Y., WAHID, A., & KIRMANI, M. M. (2025). A feature-free deep learning approach for midair hand gesture recognition from surface electromyogram (sEMG) data. Turkish Journal of Electrical Engineering and Computer Sciences, 33(6), 688-705. https://doi.org/10.55730/1300-0632.4152
Vancouver
ALTAF Y, WAHID A, KIRMANI MM. A feature-free deep learning approach for midair hand gesture recognition from surface electromyogram (sEMG) data. Turkish Journal of Electrical Engineering and Computer Sciences. 2025;33(6):688-705. doi:10.55730/1300-0632.4152
BibTeX
@article{ALTAF2025,
author = {ALTAF, YASIR and WAHID, ABDUL and KIRMANI, MUDASIR MANZOOR},
title = {A feature-free deep learning approach for midair hand gesture recognition from surface electromyogram (sEMG) data},
journal = {Turkish Journal of Electrical Engineering and Computer Sciences},
year = {2025},
volume = {33},
number = {6},
pages = {688--705},
doi = {10.55730/1300-0632.4152}
}
EUVIMED