Smart Home Automation-Based Hand Gesture Recognition Using Feature Fusion and Recurrent Neural Network
Sensors · 30.08.2023 · 23 (17) · 7523
DOI: 10.3390/s23177523 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 30.08.2023. Verfasst von Bayan Ibrahimm Alabdullah und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Information Systems, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh …. Hauptthemen laut MEDLINE: Gestures, Nerve Agents. Die Arbeit wurde bisher 84-mal zitiert (Crossref) und nennt 79 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Princess Nourah bint Abdulrahman University Researchers, Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia, Najran University.
Abstract (Originalsprache)
Gestures have been used for nonverbal communication for a long time, but human–computer interaction (HCI) via gestures is becoming more common in the modern era. To obtain a greater recognition rate, the traditional interface comprises various devices, such as gloves, physical controllers, and markers. This study provides a new markerless technique for obtaining gestures without the need for any barriers or pricey hardware. In this paper, dynamic gestures are first converted into frames. The noise is removed, and intensity is adjusted for feature extraction. The hand gesture is first detected through the images, and the skeleton is computed through mathematical computations. From the skeleton, the features are extracted; these features include joint color cloud, neural gas, and directional active model. After that, the features are optimized, and a selective feature set is passed through the classifier recurrent neural network (RNN) to obtain the classification results with higher accuracy. The proposed model is experimentally assessed and trained over three datasets: HaGRI, Egogesture, and Jester. The experimental results for the three datasets provided improved results based on classification, and the proposed system achieved an accuracy of 92.57% over HaGRI, 91.86% over Egogesture, and 91.57% over the Jester dataset, respectively. Also, to check the model liability, the proposed method was tested on the WLASL dataset, attaining 90.43% accuracy. This paper also includes a comparison with other-state-of-the art methods to compare our model with the standard methods of recognition. Our model presented a higher accuracy rate with a markerless approach to save money and time for classifying the gestures for better interaction.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Substanzen
Autor:innen und Institutionen
- Department of Information Systems, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia.
- Department of Computer Science, Air University, E-9, Islamabad 44000, Pakistan.
- Department of Computer Science, College of Computer Science and Information System, Najran University, Najran 55461, Saudi Arabia.
- Department of Computer Science and Artificial Intelligence, College of Computer Science and Engineering, University of Jeddah, Jeddah 21589, Saudi Arabia.
- Information Systems Department, Umm Al-Qura University, Makkah 24382, Saudi Arabia.
ORCID-Profile: Naif Al Mudawi, Abdulwahab Alazeb, Saud S Alotaibi
Förderung
- Princess Nourah bint Abdulrahman University Researchers
- Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia
- Najran University
Zitieren
APA
Alabdullah, B. I., Ansar, H., Mudawi, N. A., Alazeb, A., Alshahrani, A., Alotaibi, S. S., & Jalal, A. (2023). Smart Home Automation-Based Hand Gesture Recognition Using Feature Fusion and Recurrent Neural Network. Sensors, 23(17), 7523. https://doi.org/10.3390/s23177523
Vancouver
Alabdullah BI, Ansar H, Mudawi NA, Alazeb A, Alshahrani A, Alotaibi SS, et al. Smart Home Automation-Based Hand Gesture Recognition Using Feature Fusion and Recurrent Neural Network. Sensors. 2023;23(17):7523. doi:10.3390/s23177523
BibTeX
@article{Alabdullah2023,
author = {Alabdullah, Bayan Ibrahimm and Ansar, Hira and Mudawi, Naif Al and Alazeb, Abdulwahab and Alshahrani, Abdullah and Alotaibi, Saud S and Jalal, Ahmad},
title = {Smart Home Automation-Based Hand Gesture Recognition Using Feature Fusion and Recurrent Neural Network},
journal = {Sensors},
year = {2023},
volume = {23},
number = {17},
pages = {7523},
doi = {10.3390/s23177523}
}
EUVIMED