EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

Edge Computing Approach to AI-Based Gesture for Human–Robot Interaction and Control

Nikola Ivačko, Ivan Ćirić, Miloš Simonović

Computers · 2026-04-14 · 15 (4) · 241

DOI: 10.3390/computers15040241 ↗

At a glance

Journal article in Computers, published online on 2026-04-14. Written by Nikola Ivačko and 2 co-authors. Cited 3 times so far (Crossref); 45 references. The full text is freely available (open access, CC BY 4.0). Funded by: Ministry of Science, Technological Development and Innovation of the Republic of Serbia.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

This paper presents an edge-deployable vision-based framework for human–robot interaction using a xArm collaborative robot and a single RGB camera mounted on the robot wrist, and lightweight AI-based perception modules. The system enables intuitive, contact-free control by combining hand understanding and object detection within a unified perception–decision–control pipeline. Hand landmarks are extracted using MediaPipe Hands, from which continuous hand trajectories, static gestures, and dynamic gestures are derived. Task objects are detected using a YOLO-based model, and both hand and object observations are mapped into the robot workspace using ArUco-based planar calibration. To ensure stable robot motion, the hand control signal is smoothed using low-pass and Kalman filtering, while dynamic gestures such as waving are recognized using a lightweight LSTM classifier. The complete pipeline runs locally on edge hardware, specifically NVIDIA Jetson Orin Nano and Raspberry Pi 5 with a Hailo AI accelerator. Experimental evaluation includes trajectory stability, gesture recognition reliability, and runtime performance on both platforms. Results show that filtering significantly reduces hand-tracking jitter, gesture recognition provides stable command states for control, and both edge devices support real-time operation, with Jetson achieving consistently lower runtime than Raspberry Pi. The proposed system demonstrates the feasibility of low-cost edge AI solutions for responsive and practical human–robot interaction in collaborative industrial environments.

Funding

  • Ministry of Science, Technological Development and Innovation of the Republic of Serbia

Cite

APA

Ivačko, N., Ćirić, I., & Simonović, M. (2026). Edge Computing Approach to AI-Based Gesture for Human–Robot Interaction and Control. Computers, 15(4), 241. https://doi.org/10.3390/computers15040241

Vancouver

Ivačko N, Ćirić I, Simonović M. Edge Computing Approach to AI-Based Gesture for Human–Robot Interaction and Control. Computers. 2026;15(4):241. doi:10.3390/computers15040241

BibTeX
@article{Ivako2026,
  author = {Ivačko, Nikola and Ćirić, Ivan and Simonović, Miloš},
  title = {Edge Computing Approach to AI-Based Gesture for Human–Robot Interaction and Control},
  journal = {Computers},
  year = {2026},
  volume = {15},
  number = {4},
  pages = {241},
  doi = {10.3390/computers15040241}
}
Start for free →