Online Hand Gesture Detection and Recognition for UAV Motion Planning
Machines · 01.02.2023 · 11 (2) · 210
DOI: 10.3390/machines11020210 ↗Kurz gefasst
Fachartikel in der Zeitschrift Machines, online erschienen am 01.02.2023. Verfasst von Cong Lu und 6 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Science and technology innovation 2030 major projects, National Natural Science Foundation of China, Shanghai Municipal Science and Technology Major Project.
Abstract (Originalsprache)
Recent advances in hand gesture recognition have produced more natural and intuitive methods of controlling unmanned aerial vehicles (UAVs). However, in unknown and cluttered environments, UAV motion planning requires the assistance of hand gesture interaction in complex flight tasks, which remains a significant challenge. In this paper, a novel framework based on hand gesture interaction is proposed, to support efficient and robust UAV flight. A cascading structure, which includes Gaussian Native Bayes (GNB) and Random Forest (RF), was designed, to classify hand gestures based on the Six Degrees of Freedom (6DoF) inertial measurement units (IMUs) of the data glove. The hand gestures were mapped onto UAV’s flight commands, which corresponded to the direction of the UAV flight.The experimental results, which tested the 10 evaluated hand gestures, revealed the high accuracy of online hand gesture recognition under asynchronous detection (92%), and relatively low latency for interaction (average recognition time of 7.5 ms; average total time of 3 s).The average time of the UAV’s complex flight task was about 8 s shorter than that of the synchronous hand gesture detection and recognition. The proposed framework was validated as efficient and robust, with extensive benchmark comparisons in various complex real-world environments.
Förderung
- Science and technology innovation 2030 major projects
- National Natural Science Foundation of China
- Shanghai Municipal Science and Technology Major Project
- Program of Introducing Talents of Discipline to Universities through the 111 Project
- ShuGuang Project supported by the Shanghai Municipal Education Commission and the Shanghai Education Development Foundation
- Ministry of Education and Science of the Russian Federation
- Polish National Science Center
- National Government Guided Special Funds for Local Science and Technology Development (Shenzhen, China)
Zitieren
APA
Lu, C., Zhang, H., Pei, Y., Xie, L., Yan, Y., Yin, E., & Jin, J. (2023). Online Hand Gesture Detection and Recognition for UAV Motion Planning. Machines, 11(2), 210. https://doi.org/10.3390/machines11020210
Vancouver
Lu C, Zhang H, Pei Y, Xie L, Yan Y, Yin E, et al. Online Hand Gesture Detection and Recognition for UAV Motion Planning. Machines. 2023;11(2):210. doi:10.3390/machines11020210
BibTeX
@article{Lu2023,
author = {Lu, Cong and Zhang, Haoyang and Pei, Yu and Xie, Liang and Yan, Ye and Yin, Erwei and Jin, Jing},
title = {Online Hand Gesture Detection and Recognition for UAV Motion Planning},
journal = {Machines},
year = {2023},
volume = {11},
number = {2},
pages = {210},
doi = {10.3390/machines11020210}
}
EUVIMED