EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Recognition, Stabilization, and Command-Mapping Algorithms for Contactless Hand-Gesture Control of an ABB Industrial Robot

Bartosz Bieńkowski, Wojciech Kaczmarek iD

Sensors · 09.11.2026 · 26 (21) · 7073

DOI: 10.3390/s26217073 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 09.11.2026. Verfasst von Bartosz Bieńkowski und 1 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Electronics, Military University of Technology, 00-908 Warsaw, Poland. Hauptthemen laut MEDLINE: Robotics, Algorithms, Hand, Gestures. Die Arbeit nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Although contactless hand-gesture interfaces can support intuitive human–robot interaction, transient classification errors may trigger unintended commands when classifier outputs are mapped directly to robot actions. This study presents a processing framework for contactless control of an ABB IRB 120 industrial robot. The framework combines RGB acquisition, geometric normalization of 21 MediaPipe hand landmarks, population-based sample filtering, multilayer perceptron classification, temporal transition stabilization, and a two-hand command grammar. Thirteen gesture classes were represented by 63-dimensional landmark vectors, and 19,250 samples were retained after processing. The classifier achieved an approximate mean per-class recall of 99.46% on the held-out test subset. Four temporal processing configurations were compared using 30 repetitions per interface action: raw output, majority voting, three-consecutive-label confirmation, and the proposed cellular-automaton (CA)-based stabilizer. The latter two methods improved command reliability relative to the raw output and produced comparable results. The CA stabilizer processed labels sampled every 100 ms and introduced a validation delay of approximately 300 ms. Robot-program control achieved an 86.7% success rate across 90 trials, while Cartesian direction control achieved a 97.2% success rate across 180 trials. The mean displacement overshoot was 2.42 mm, or 24.2% of the nominal 10 mm command. The framework provides a practical perception-to-control interface while complementing, rather than replacing, certified robot safety functions.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

RoboticsAlgorithmsHandGesturesPattern Recognition, AutomatedHumans

Stichwörter der Autor:innen

cellular automatoncommand mappingcontactless robot controlhand gesture recognitionhuman–robot interactionindustrial robotvision-based sensing

Autor:innen und Institutionen

  • Faculty of Electronics, Military University of Technology, 00-908 Warsaw, Poland.
  • Faculty of Mechatronics, Armaments, and Aerospace, Military University of Technology, 00-908 Warsaw, Poland.

ORCID-Profile: Wojciech Kaczmarek

Zitieren

APA

Bieńkowski, B., & Kaczmarek, W. (2026). Recognition, Stabilization, and Command-Mapping Algorithms for Contactless Hand-Gesture Control of an ABB Industrial Robot. Sensors, 26(21), 7073. https://doi.org/10.3390/s26217073

Vancouver

Bieńkowski B, Kaczmarek W. Recognition, Stabilization, and Command-Mapping Algorithms for Contactless Hand-Gesture Control of an ABB Industrial Robot. Sensors. 2026;26(21):7073. doi:10.3390/s26217073

BibTeX
@article{Biekowski2026,
  author = {Bieńkowski, Bartosz and Kaczmarek, Wojciech},
  title = {Recognition, Stabilization, and Command-Mapping Algorithms for Contactless Hand-Gesture Control of an ABB Industrial Robot},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {21},
  pages = {7073},
  doi = {10.3390/s26217073}
}
Kostenlos starten →