Research Progress on Technologies and Applications of Human-Computer Interaction Gestures Based on Vision and Sensors
Mathematical Modeling and Algorithm Application · 15.03.2026 · 9 (1) · 332-341
DOI: 10.54097/0vg95866 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mathematical Modeling and Algorithm Application, online erschienen am 15.03.2026. Verfasst von Linhao Li. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Against the backdrop of rapid Artificial Intelligence (AI) and Internet of Thing (IoT) advancement, traditional HCI modalities (keyboards, mice) show limitations, spurring attention to intuitive gesture interaction—a core part of NUIs. This technology mainly has two routes. Vision-based systems use cameras, with deep learning (e.g., YOLOv5 for hand detection, CNN for feature extraction) enabling tasks like keypoint and spatio-temporal feature analysis, and real-time recognition via stereo image fusion. Sensor-based systems include wearable (EMG sensors, smart gloves) and non-wearable (Leap Motion, Kinect, WDHS) devices, with multi-sensor fusion enhancing robustness; bioimpedance measurement is an emerging non-wearable method. These technologies apply to intelligent HCI, disability assistance, VR/AR, and healthcare but face challenges like poor environmental robustness and high computing demands, playing a key role in advancing HCI. Looking forward, gesture recognition is expected to evolve toward more natural, adaptive, and multimodal interaction modes by integrating speech, eye tracking, and emotion recognition for context-aware communication.
Zitieren
APA
Li, L. (2026). Research Progress on Technologies and Applications of Human-Computer Interaction Gestures Based on Vision and Sensors. Mathematical Modeling and Algorithm Application, 9(1), 332-341. https://doi.org/10.54097/0vg95866
Vancouver
Li L. Research Progress on Technologies and Applications of Human-Computer Interaction Gestures Based on Vision and Sensors. Mathematical Modeling and Algorithm Application. 2026;9(1):332-341. doi:10.54097/0vg95866
BibTeX
@article{Li2026,
author = {Li, Linhao},
title = {Research Progress on Technologies and Applications of Human-Computer Interaction Gestures Based on Vision and Sensors},
journal = {Mathematical Modeling and Algorithm Application},
year = {2026},
volume = {9},
number = {1},
pages = {332--341},
doi = {10.54097/0vg95866}
}
EUVIMED