EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Hybrid Image Augmentation Technique for User- and Environment-Independent Hand Gesture Recognition Based on Deep Learning

Baiti-Ahmad Awaluddin, Chun-Tang Chao, Juing-Shian Chiou

Mathematics · 02.05.2024 · 12 (9) · 1393

DOI: 10.3390/math12091393 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Mathematics, online erschienen am 02.05.2024. Verfasst von Baiti-Ahmad Awaluddin und 2 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 83 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science and Technology Council, Taiwan.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This research stems from the increasing use of hand gestures in various applications, such as sign language recognition to electronic device control. The focus is the importance of accuracy and robustness in recognizing hand gestures to avoid misinterpretation and instruction errors. However, many experiments on hand gesture recognition are conducted in limited laboratory environments, which do not fully reflect the everyday use of hand gestures. Therefore, the importance of an ideal background in hand gesture recognition, involving only the signer without any distracting background, is highlighted. In the real world, the use of hand gestures involves various unique environmental conditions, including differences in background colors, varying lighting conditions, and different hand gesture positions. However, the datasets available to train hand gesture recognition models often lack sufficient variability, thereby hindering the development of accurate and adaptable systems. This research aims to develop a robust hand gesture recognition model capable of operating effectively in diverse real-world environments. By leveraging deep learning-based image augmentation techniques, the study seeks to enhance the accuracy of hand gesture recognition by simulating various environmental conditions. Through data duplication and augmentation methods, including background, geometric, and lighting adjustments, the diversity of the primary dataset is expanded to improve the effectiveness of model training. It is important to note that the utilization of the green screen technique, combined with geometric and lighting augmentation, significantly contributes to the model’s ability to recognize hand gestures accurately. The research results show a significant improvement in accuracy, especially with implementing the proposed green screen technique, underscoring its effectiveness in adapting to various environmental contexts. Additionally, the study emphasizes the importance of adjusting augmentation techniques to the dataset’s characteristics for optimal performance. These findings provide valuable insights into the practical application of hand gesture recognition technology and pave the way for further research in tailoring techniques to datasets with varying complexities and environmental variations.

Förderung

  • National Science and Technology Council, Taiwan

Zitieren

APA

Awaluddin, B., Chao, C., & Chiou, J. (2024). A Hybrid Image Augmentation Technique for User- and Environment-Independent Hand Gesture Recognition Based on Deep Learning. Mathematics, 12(9), 1393. https://doi.org/10.3390/math12091393

Vancouver

Awaluddin B, Chao C, Chiou J. A Hybrid Image Augmentation Technique for User- and Environment-Independent Hand Gesture Recognition Based on Deep Learning. Mathematics. 2024;12(9):1393. doi:10.3390/math12091393

BibTeX
@article{Awaluddin2024,
  author = {Awaluddin, Baiti-Ahmad and Chao, Chun-Tang and Chiou, Juing-Shian},
  title = {A Hybrid Image Augmentation Technique for User- and Environment-Independent Hand Gesture Recognition Based on Deep Learning},
  journal = {Mathematics},
  year = {2024},
  volume = {12},
  number = {9},
  pages = {1393},
  doi = {10.3390/math12091393}
}
Kostenlos starten →