Advancing Virtual Lab Immersion Through YOLO-Powered Gesture Recognition in Natural HCI
CoED · 2026-02 · 15 (1)
DOI: 10.18260/b34c-90-33361 ↗Kurz gefasst
Fachartikel in der Zeitschrift CoED, 2026-02. Verfasst von Zhou Zhang und 1 weiteren Autor:innen.
Abstract (Originalsprache)
This study presents a gesture-based human-computer interaction (HCI) system for virtual engineering education, leveraging a modified YOLO-NAS Pose model for real-time hand gesture recognition. Unlike traditional input methods (mouse and keyboard) and commercially available virtual interfaces, this approach provides natural interaction within a screen-based electrical power lab simulation. The proposed system was benchmarked against MediaPipe, OpenPose, and CNN-based models, demonstrating superior inference speed (~2.35ms per frame on NVIDIA T4) with competitive accuracy (96.2%), making it highly suitable for real-time educational applications.
Zitieren
APA
Zhang, Z., & Ali, M. L. (2026). Advancing Virtual Lab Immersion Through YOLO-Powered Gesture Recognition in Natural HCI. CoED, 15(1). https://doi.org/10.18260/b34c-90-33361
Vancouver
Zhang Z, Ali ML. Advancing Virtual Lab Immersion Through YOLO-Powered Gesture Recognition in Natural HCI. CoED. 2026;15(1). doi:10.18260/b34c-90-33361
BibTeX
@article{Zhang2026,
author = {Zhang, Zhou and Ali, Momina Liaqat},
title = {Advancing Virtual Lab Immersion Through YOLO-Powered Gesture Recognition in Natural HCI},
journal = {CoED},
year = {2026},
volume = {15},
number = {1},
doi = {10.18260/b34c-90-33361}
}
EUVIMED