EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Research Progress on Technologies and Applications of Human-Computer Interaction Gestures Based on Vision and Sensors

Linhao Li

Mathematical Modeling and Algorithm Application · 15.03.2026 · 9 (1) · 332-341

DOI: 10.54097/0vg95866 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Mathematical Modeling and Algorithm Application, online erschienen am 15.03.2026. Verfasst von Linhao Li. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Against the backdrop of rapid Artificial Intelligence (AI) and Internet of Thing (IoT) advancement, traditional HCI modalities (keyboards, mice) show limitations, spurring attention to intuitive gesture interaction—a core part of NUIs. This technology mainly has two routes. Vision-based systems use cameras, with deep learning (e.g., YOLOv5 for hand detection, CNN for feature extraction) enabling tasks like keypoint and spatio-temporal feature analysis, and real-time recognition via stereo image fusion. Sensor-based systems include wearable (EMG sensors, smart gloves) and non-wearable (Leap Motion, Kinect, WDHS) devices, with multi-sensor fusion enhancing robustness; bioimpedance measurement is an emerging non-wearable method. These technologies apply to intelligent HCI, disability assistance, VR/AR, and healthcare but face challenges like poor environmental robustness and high computing demands, playing a key role in advancing HCI. Looking forward, gesture recognition is expected to evolve toward more natural, adaptive, and multimodal interaction modes by integrating speech, eye tracking, and emotion recognition for context-aware communication.

Zitieren

APA

Li, L. (2026). Research Progress on Technologies and Applications of Human-Computer Interaction Gestures Based on Vision and Sensors. Mathematical Modeling and Algorithm Application, 9(1), 332-341. https://doi.org/10.54097/0vg95866

Vancouver

Li L. Research Progress on Technologies and Applications of Human-Computer Interaction Gestures Based on Vision and Sensors. Mathematical Modeling and Algorithm Application. 2026;9(1):332-341. doi:10.54097/0vg95866

BibTeX
@article{Li2026,
  author = {Li, Linhao},
  title = {Research Progress on Technologies and Applications of Human-Computer Interaction Gestures Based on Vision and Sensors},
  journal = {Mathematical Modeling and Algorithm Application},
  year = {2026},
  volume = {9},
  number = {1},
  pages = {332--341},
  doi = {10.54097/0vg95866}
}
Kostenlos starten →