Edge Computing Approach to AI-Based Gesture for Human–Robot Interaction and Control
Computers · 14.04.2026 · 15 (4) · 241
DOI: 10.3390/computers15040241 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computers, online erschienen am 14.04.2026. Verfasst von Nikola Ivačko und 2 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Science, Technological Development and Innovation of the Republic of Serbia.
Abstract (Originalsprache)
This paper presents an edge-deployable vision-based framework for human–robot interaction using a xArm collaborative robot and a single RGB camera mounted on the robot wrist, and lightweight AI-based perception modules. The system enables intuitive, contact-free control by combining hand understanding and object detection within a unified perception–decision–control pipeline. Hand landmarks are extracted using MediaPipe Hands, from which continuous hand trajectories, static gestures, and dynamic gestures are derived. Task objects are detected using a YOLO-based model, and both hand and object observations are mapped into the robot workspace using ArUco-based planar calibration. To ensure stable robot motion, the hand control signal is smoothed using low-pass and Kalman filtering, while dynamic gestures such as waving are recognized using a lightweight LSTM classifier. The complete pipeline runs locally on edge hardware, specifically NVIDIA Jetson Orin Nano and Raspberry Pi 5 with a Hailo AI accelerator. Experimental evaluation includes trajectory stability, gesture recognition reliability, and runtime performance on both platforms. Results show that filtering significantly reduces hand-tracking jitter, gesture recognition provides stable command states for control, and both edge devices support real-time operation, with Jetson achieving consistently lower runtime than Raspberry Pi. The proposed system demonstrates the feasibility of low-cost edge AI solutions for responsive and practical human–robot interaction in collaborative industrial environments.
Förderung
- Ministry of Science, Technological Development and Innovation of the Republic of Serbia
Zitieren
APA
Ivačko, N., Ćirić, I., & Simonović, M. (2026). Edge Computing Approach to AI-Based Gesture for Human–Robot Interaction and Control. Computers, 15(4), 241. https://doi.org/10.3390/computers15040241
Vancouver
Ivačko N, Ćirić I, Simonović M. Edge Computing Approach to AI-Based Gesture for Human–Robot Interaction and Control. Computers. 2026;15(4):241. doi:10.3390/computers15040241
BibTeX
@article{Ivako2026,
author = {Ivačko, Nikola and Ćirić, Ivan and Simonović, Miloš},
title = {Edge Computing Approach to AI-Based Gesture for Human–Robot Interaction and Control},
journal = {Computers},
year = {2026},
volume = {15},
number = {4},
pages = {241},
doi = {10.3390/computers15040241}
}
EUVIMED