EUVIMEDEUVIMED entdecken
Crossref

Advancing Virtual Lab Immersion Through YOLO-Powered Gesture Recognition in Natural HCI

Zhou Zhang, Momina Liaqat Ali

CoED · 2026-02 · 15 (1)

DOI: 10.18260/b34c-90-33361 ↗

Kurz gefasst

Fachartikel in der Zeitschrift CoED, 2026-02. Verfasst von Zhou Zhang und 1 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study presents a gesture-based human-computer interaction (HCI) system for virtual engineering education, leveraging a modified YOLO-NAS Pose model for real-time hand gesture recognition. Unlike traditional input methods (mouse and keyboard) and commercially available virtual interfaces, this approach provides natural interaction within a screen-based electrical power lab simulation. The proposed system was benchmarked against MediaPipe, OpenPose, and CNN-based models, demonstrating superior inference speed (~2.35ms per frame on NVIDIA T4) with competitive accuracy (96.2%), making it highly suitable for real-time educational applications.

Zitieren

APA

Zhang, Z., & Ali, M. L. (2026). Advancing Virtual Lab Immersion Through YOLO-Powered Gesture Recognition in Natural HCI. CoED, 15(1). https://doi.org/10.18260/b34c-90-33361

Vancouver

Zhang Z, Ali ML. Advancing Virtual Lab Immersion Through YOLO-Powered Gesture Recognition in Natural HCI. CoED. 2026;15(1). doi:10.18260/b34c-90-33361

BibTeX
@article{Zhang2026,
  author = {Zhang, Zhou and Ali, Momina Liaqat},
  title = {Advancing Virtual Lab Immersion Through YOLO-Powered Gesture Recognition in Natural HCI},
  journal = {CoED},
  year = {2026},
  volume = {15},
  number = {1},
  doi = {10.18260/b34c-90-33361}
}
Kostenlos starten →