Real-Time Hand Gesture Monitoring Model Based on MediaPipe’s Registerable System
Sensors · 27.09.2024 · 24 (19) · 6262
DOI: 10.3390/s24196262 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 27.09.2024. Verfasst von Yuting Meng und 3 weiteren Autor:innen. Beteiligte Einrichtung: College of Mechanical Engineering, North University of China, Taiyuan 030051, China. Hauptthemen laut MEDLINE: Hand, Gestures. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Hand gesture recognition plays a significant role in human-to-human and human-to-machine interactions. Currently, most hand gesture detection methods rely on fixed hand gesture recognition. However, with the diversity and variability of hand gestures in daily life, this paper proposes a registerable hand gesture recognition approach based on Triple Loss. By learning the differences between different hand gestures, it can cluster them and identify newly added gestures. This paper constructs a registerable gesture dataset (RGDS) for training registerable hand gesture recognition models. Additionally, it proposes a normalization method for transforming hand gesture data and a FingerComb block for combining and extracting hand gesture data to enhance features and accelerate model convergence. It also improves ResNet and introduces FingerNet for registerable single-hand gesture recognition. The proposed model performs well on the RGDS dataset. The system is registerable, allowing users to flexibly register their own hand gestures for personalized gesture recognition.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- College of Mechanical Engineering, North University of China, Taiyuan 030051, China.
- SIMITECH Co., Xi'an 710086, China.
Zitieren
APA
Meng, Y., Jiang, H., Duan, N., & Wen, H. (2024). Real-Time Hand Gesture Monitoring Model Based on MediaPipe’s Registerable System. Sensors, 24(19), 6262. https://doi.org/10.3390/s24196262
Vancouver
Meng Y, Jiang H, Duan N, Wen H. Real-Time Hand Gesture Monitoring Model Based on MediaPipe’s Registerable System. Sensors. 2024;24(19):6262. doi:10.3390/s24196262
BibTeX
@article{Meng2024,
author = {Meng, Yuting and Jiang, Haibo and Duan, Nengquan and Wen, Haijun},
title = {Real-Time Hand Gesture Monitoring Model Based on MediaPipe’s Registerable System},
journal = {Sensors},
year = {2024},
volume = {24},
number = {19},
pages = {6262},
doi = {10.3390/s24196262}
}
EUVIMED