EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Real-Time Hand Gesture Monitoring Model Based on MediaPipe’s Registerable System

Yuting Meng, Haibo Jiang, Nengquan Duan, Haijun Wen

Sensors · 27.09.2024 · 24 (19) · 6262

DOI: 10.3390/s24196262 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 27.09.2024. Verfasst von Yuting Meng und 3 weiteren Autor:innen. Beteiligte Einrichtung: College of Mechanical Engineering, North University of China, Taiyuan 030051, China. Hauptthemen laut MEDLINE: Hand, Gestures. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Hand gesture recognition plays a significant role in human-to-human and human-to-machine interactions. Currently, most hand gesture detection methods rely on fixed hand gesture recognition. However, with the diversity and variability of hand gestures in daily life, this paper proposes a registerable hand gesture recognition approach based on Triple Loss. By learning the differences between different hand gestures, it can cluster them and identify newly added gestures. This paper constructs a registerable gesture dataset (RGDS) for training registerable hand gesture recognition models. Additionally, it proposes a normalization method for transforming hand gesture data and a FingerComb block for combining and extracting hand gesture data to enhance features and accelerate model convergence. It also improves ResNet and introduces FingerNet for registerable single-hand gesture recognition. The proposed model performs well on the RGDS dataset. The system is registerable, allowing users to flexibly register their own hand gestures for personalized gesture recognition.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

HandGesturesTime FactorsElectronic Data ProcessingPattern Recognition, Automated

Stichwörter der Autor:innen

Triple Lossgesture recognitionmachine learningreal-time monitoring

Autor:innen und Institutionen

  • College of Mechanical Engineering, North University of China, Taiyuan 030051, China.
  • SIMITECH Co., Xi'an 710086, China.

Zitieren

APA

Meng, Y., Jiang, H., Duan, N., & Wen, H. (2024). Real-Time Hand Gesture Monitoring Model Based on MediaPipe’s Registerable System. Sensors, 24(19), 6262. https://doi.org/10.3390/s24196262

Vancouver

Meng Y, Jiang H, Duan N, Wen H. Real-Time Hand Gesture Monitoring Model Based on MediaPipe’s Registerable System. Sensors. 2024;24(19):6262. doi:10.3390/s24196262

BibTeX
@article{Meng2024,
  author = {Meng, Yuting and Jiang, Haibo and Duan, Nengquan and Wen, Haijun},
  title = {Real-Time Hand Gesture Monitoring Model Based on MediaPipe’s Registerable System},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {19},
  pages = {6262},
  doi = {10.3390/s24196262}
}
Kostenlos starten →