EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Multi-Model CNN Approach Using Pre-Trained Network for Improved Hand Gesture Recognition

Yeou-Jiunn Chen, Aryanti Aryanti, Qian-Bei Hong

Applied System Innovation · 13.05.2026 · 9 (5) · 100

DOI: 10.3390/asi9050100 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied System Innovation, online erschienen am 13.05.2026. Verfasst von Yeou-Jiunn Chen und 2 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science and Technology Council.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Hand gesture recognition (HGR) is a critical area in computer vision that supports intuitive human–computer interaction and sign language communication, yet existing systems remain sensitive to lighting variations, background clutter, and diverse hand postures. This study introduces two contributions to address these limitations: a Gradient-Based Augmentation Validation (GBAV) framework that establishes structurally safe augmentation ranges before training, and a multi-backbone Convolutional Neural Network (CNN) architecture combining ResNet50 and InceptionV3 with optional attention-based pooling. GBAV uses magnitude-weighted gradient orientation histograms with Pearson correlation and Kullback–Leibler divergence thresholds to verify label invariance under spatial transformations, providing a classifier-agnostic pre-training calibration mechanism. The proposed framework is evaluated on three static gesture datasets, Indonesian Sign Language (BISINDO), American Sign Language (ASL), and Hand Gesture 14 (HG14), yielding validation accuracies of 96.87%, 99.92%, and 95.25%, respectively, with 5-fold cross-validation on HG14 confirming result stability (93.51% ± 2.31%). Quantitative attention localization, cross-dataset transfer evaluation, and computational efficiency analysis (26.8 ms per image, ~37 FPS) further support the framework’s robustness and practical deployability. These findings establish GBAV-calibrated augmentation as the principal performance driver, which complements the multi-backbone architecture for robust hand gesture recognition across diverse visual contexts.

Förderung

  • National Science and Technology Council

Zitieren

APA

Chen, Y., Aryanti, A., & Hong, Q. (2026). A Multi-Model CNN Approach Using Pre-Trained Network for Improved Hand Gesture Recognition. Applied System Innovation, 9(5), 100. https://doi.org/10.3390/asi9050100

Vancouver

Chen Y, Aryanti A, Hong Q. A Multi-Model CNN Approach Using Pre-Trained Network for Improved Hand Gesture Recognition. Applied System Innovation. 2026;9(5):100. doi:10.3390/asi9050100

BibTeX
@article{Chen2026,
  author = {Chen, Yeou-Jiunn and Aryanti, Aryanti and Hong, Qian-Bei},
  title = {A Multi-Model CNN Approach Using Pre-Trained Network for Improved Hand Gesture Recognition},
  journal = {Applied System Innovation},
  year = {2026},
  volume = {9},
  number = {5},
  pages = {100},
  doi = {10.3390/asi9050100}
}
Kostenlos starten →