EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Novel Sensor Fusion Approach for Precise Hand Tracking in Virtual Reality-Based Human—Computer Interaction

Yu Lei iD, Yi Deng, Lin Dong, Xiaohui Li, Xiangnan Li, Zhi Su

Biomimetics · 22.07.2023 · 8 (3) · 326

DOI: 10.3390/biomimetics8030326 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Biomimetics, online erschienen am 22.07.2023. Verfasst von Yu Lei und 5 weiteren Autor:innen. Beteiligte Einrichtung: College of Humanities and Arts, Hunan International Economics University, Changsha 410012, China. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The rapidly evolving field of Virtual Reality (VR)-based Human–Computer Interaction (HCI) presents a significant demand for robust and accurate hand tracking solutions. Current technologies, predominantly based on single-sensing modalities, fall short in providing comprehensive information capture due to susceptibility to occlusions and environmental factors. In this paper, we introduce a novel sensor fusion approach combined with a Long Short-Term Memory (LSTM)-based algorithm for enhanced hand tracking in VR-based HCI. Our system employs six Leap Motion controllers, two RealSense depth cameras, and two Myo armbands to yield a multi-modal data capture. This rich data set is then processed using LSTM, ensuring the accurate real-time tracking of complex hand movements. The proposed system provides a powerful tool for intuitive and immersive interactions in VR environments.

Schlagwörter

Stichwörter der Autor:innen

hand trackinghuman–computer interactionmulti-modal dataneural networkssensor fusion

Autor:innen und Institutionen

  • College of Humanities and Arts, Hunan International Economics University, Changsha 410012, China.
  • College of Physical Education, Hunan International Economics University, Changsha 410012, China.
  • Institute of Sports Artificial Intelligence, Capital University of Physical Education and Sports, Beijing 100091, China.
  • Department of Wushu and China, Songshan Shaolin Wushu College, Zhengzhou 452470, China.
  • Department of History and Pakistan, University of the Punjab, Lahore 54000, Pakistan.
  • Yantai Science and Technology Innovation Promotion Center, Yantai 264005, China.

ORCID-Profile: Yu Lei

Zitieren

APA

Lei, Y., Deng, Y., Dong, L., Li, X., Li, X., & Su, Z. (2023). A Novel Sensor Fusion Approach for Precise Hand Tracking in Virtual Reality-Based Human—Computer Interaction. Biomimetics, 8(3), 326. https://doi.org/10.3390/biomimetics8030326

Vancouver

Lei Y, Deng Y, Dong L, Li X, Li X, Su Z. A Novel Sensor Fusion Approach for Precise Hand Tracking in Virtual Reality-Based Human—Computer Interaction. Biomimetics. 2023;8(3):326. doi:10.3390/biomimetics8030326

BibTeX
@article{Lei2023,
  author = {Lei, Yu and Deng, Yi and Dong, Lin and Li, Xiaohui and Li, Xiangnan and Su, Zhi},
  title = {A Novel Sensor Fusion Approach for Precise Hand Tracking in Virtual Reality-Based Human—Computer Interaction},
  journal = {Biomimetics},
  year = {2023},
  volume = {8},
  number = {3},
  pages = {326},
  doi = {10.3390/biomimetics8030326}
}
Kostenlos starten →