EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Virtual Reality Integrated Human–Computer Interaction System Based on Ultraleap 3Di Hand Gestures Recognition

Chujie He, Xiangyu Zhou, Jiarui Zhang, Jing Luo, Yahong Chen, Xiaoli Liu, Shifeng Ma, Junjie Sun

IET Cyber-Systems and Robotics · 2025-01 · 7 (1)

DOI: 10.1049/csy2.70035 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IET Cyber-Systems and Robotics, online erschienen am 22.11.2025. Verfasst von Chujie He und 7 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Gesture recognition is a key task in the field of human–computer interaction (HCI). To solve the problems of low accuracy and poor real‐time performance in the recognition process, this paper designs a HCI system based on gesture recognition. This paper utilises the Ultraleap 3Di to collect the dynamic gesture dataset for the defined interaction gestures, and the high‐precision device guarantees data collection. This paper constructs a framework incorporating the advantages of convolutional neural networks (CNNs) and long short‐term memory networks (LSTM) using noncontact gesture interaction as the medium of human–computer collaboration. The framework utilises CNN to perform feature extraction on the input frame information. Then, the extracted feature sequences are fed into LSTM to process the timing information, which is very effective in classifying and recognising the defined dynamic gestures. Finally, a HCI system based on gesture recognition is designed. Based on the Unity3D platform, the UR5 robotic arm was modelled and the cyclic coordinate descent (CCD) algorithm was applied to solve the inverse kinematics, successfully realising the semantic control of gestures on the UR5 robotic arm. The experiment verifies that the CNN–LSTM network can ensure the real‐time performance of the whole system and the effectiveness and reliability of the gesture interaction system based on Ultraleap 3Di.

Zitieren

APA

He, C., Zhou, X., Zhang, J., Luo, J., Chen, Y., Liu, X., Ma, S., & Sun, J. (2025). Virtual Reality Integrated Human–Computer Interaction System Based on Ultraleap 3Di Hand Gestures Recognition. IET Cyber-Systems and Robotics, 7(1). https://doi.org/10.1049/csy2.70035

Vancouver

He C, Zhou X, Zhang J, Luo J, Chen Y, Liu X, et al. Virtual Reality Integrated Human–Computer Interaction System Based on Ultraleap 3Di Hand Gestures Recognition. IET Cyber-Systems and Robotics. 2025;7(1). doi:10.1049/csy2.70035

BibTeX
@article{He2025,
  author = {He, Chujie and Zhou, Xiangyu and Zhang, Jiarui and Luo, Jing and Chen, Yahong and Liu, Xiaoli and Ma, Shifeng and Sun, Junjie},
  title = {Virtual Reality Integrated Human–Computer Interaction System Based on Ultraleap 3Di Hand Gestures Recognition},
  journal = {IET Cyber-Systems and Robotics},
  year = {2025},
  volume = {7},
  number = {1},
  doi = {10.1049/csy2.70035}
}
Kostenlos starten →