Multi-Mode Hand Gesture-Based VR Locomotion Technique for Intuitive Telemanipulation Viewpoint Control in Tightly Arranged Logistic Environments
Sensors · 14.02.2025 · 25 (4) · 1181
DOI: 10.3390/s25041181 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 14.02.2025. Verfasst von Jaehoon Jeong und 2 weiteren Autor:innen. Beteiligte Einrichtung: Mechanical Engineering Department, Soongsil University, Seoul 06978, Republic of Korea. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NRF, IITP, National Research Foundation of Korea (NRF) funded by the Ministry of Education.
Abstract (Originalsprache)
Telemanipulation-based object-side picking with a suction gripper often faces challenges such as occlusion of the target object or the gripper and the need for precise alignment between the suction cup and the object’s surface. These issues can significantly affect task success rates in logistics environments. To address these problems, this study proposes a multi-mode hand gesture-based virtual reality (VR) locomotion method to enable intuitive and precise viewpoint control. The system utilizes a head-mounted display (HMD) camera to capture hand skeleton data, which a multi-layer perceptron (MLP) model processes. The model classifies gestures into three modes: translation, rotation, and fixed, corresponding to fist, pointing, and unknown gestures, respectively. Translation mode moves the viewpoint based on the wrist’s displacement, rotation mode adjusts the viewpoint’s angle based on the wrist’s angular displacement, and fixed mode stabilizes the viewpoint when gestures are ambiguous. A dataset of 4312 frames was used for training and validation, with 666 frames for testing. The MLP model achieved a classification accuracy of 98.4%, with precision, recall, and F1-score exceeding 0.98. These results demonstrate the system’s ability to address the challenges of telemanipulation tasks by enabling accurate gesture recognition and seamless mode transitions.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Mechanical Engineering Department, Soongsil University, Seoul 06978, Republic of Korea.
ORCID-Profile: Donghun Lee
Förderung
- NRF
- IITP
- National Research Foundation of Korea (NRF) funded by the Ministry of Education
- Institute of Information & Communications Technology Planning & Evaluation (IITP) grant funded by the Korean government (MSIT)
Zitieren
APA
Jeong, J., Choi, H., & Lee, D. (2025). Multi-Mode Hand Gesture-Based VR Locomotion Technique for Intuitive Telemanipulation Viewpoint Control in Tightly Arranged Logistic Environments. Sensors, 25(4), 1181. https://doi.org/10.3390/s25041181
Vancouver
Jeong J, Choi H, Lee D. Multi-Mode Hand Gesture-Based VR Locomotion Technique for Intuitive Telemanipulation Viewpoint Control in Tightly Arranged Logistic Environments. Sensors. 2025;25(4):1181. doi:10.3390/s25041181
BibTeX
@article{Jeong2025,
author = {Jeong, Jaehoon and Choi, Haegyeom and Lee, Donghun},
title = {Multi-Mode Hand Gesture-Based VR Locomotion Technique for Intuitive Telemanipulation Viewpoint Control in Tightly Arranged Logistic Environments},
journal = {Sensors},
year = {2025},
volume = {25},
number = {4},
pages = {1181},
doi = {10.3390/s25041181}
}
EUVIMED