A Novel Sensor Fusion Approach for Precise Hand Tracking in Virtual Reality-Based Human—Computer Interaction
Biomimetics · 22.07.2023 · 8 (3) · 326
DOI: 10.3390/biomimetics8030326 ↗Kurz gefasst
Fachartikel in der Zeitschrift Biomimetics, online erschienen am 22.07.2023. Verfasst von Yu Lei und 5 weiteren Autor:innen. Beteiligte Einrichtung: College of Humanities and Arts, Hunan International Economics University, Changsha 410012, China. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
The rapidly evolving field of Virtual Reality (VR)-based Human–Computer Interaction (HCI) presents a significant demand for robust and accurate hand tracking solutions. Current technologies, predominantly based on single-sensing modalities, fall short in providing comprehensive information capture due to susceptibility to occlusions and environmental factors. In this paper, we introduce a novel sensor fusion approach combined with a Long Short-Term Memory (LSTM)-based algorithm for enhanced hand tracking in VR-based HCI. Our system employs six Leap Motion controllers, two RealSense depth cameras, and two Myo armbands to yield a multi-modal data capture. This rich data set is then processed using LSTM, ensuring the accurate real-time tracking of complex hand movements. The proposed system provides a powerful tool for intuitive and immersive interactions in VR environments.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- College of Humanities and Arts, Hunan International Economics University, Changsha 410012, China.
- College of Physical Education, Hunan International Economics University, Changsha 410012, China.
- Institute of Sports Artificial Intelligence, Capital University of Physical Education and Sports, Beijing 100091, China.
- Department of Wushu and China, Songshan Shaolin Wushu College, Zhengzhou 452470, China.
- Department of History and Pakistan, University of the Punjab, Lahore 54000, Pakistan.
- Yantai Science and Technology Innovation Promotion Center, Yantai 264005, China.
ORCID-Profile: Yu Lei
Zitieren
APA
Lei, Y., Deng, Y., Dong, L., Li, X., Li, X., & Su, Z. (2023). A Novel Sensor Fusion Approach for Precise Hand Tracking in Virtual Reality-Based Human—Computer Interaction. Biomimetics, 8(3), 326. https://doi.org/10.3390/biomimetics8030326
Vancouver
Lei Y, Deng Y, Dong L, Li X, Li X, Su Z. A Novel Sensor Fusion Approach for Precise Hand Tracking in Virtual Reality-Based Human—Computer Interaction. Biomimetics. 2023;8(3):326. doi:10.3390/biomimetics8030326
BibTeX
@article{Lei2023,
author = {Lei, Yu and Deng, Yi and Dong, Lin and Li, Xiaohui and Li, Xiangnan and Su, Zhi},
title = {A Novel Sensor Fusion Approach for Precise Hand Tracking in Virtual Reality-Based Human—Computer Interaction},
journal = {Biomimetics},
year = {2023},
volume = {8},
number = {3},
pages = {326},
doi = {10.3390/biomimetics8030326}
}
EUVIMED