Towards Seamless Human–Robot Interaction: Integrating Computer Vision for Tool Handover and Gesture-Based Control
Applied Sciences · 25.03.2025 · 15 (7) · 3575
DOI: 10.3390/app15073575 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 25.03.2025. Verfasst von Branislav Malobický und 6 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: APVV SK-IL-RD-23-0002: Advanced Localization Sensors and Techniques for Autonomous vehicles and Robots.
Themen: Übergabe
Abstract (Originalsprache)
This paper presents the development of a robotic workstation that integrates a collaborative robot as an assistant, leveraging advanced computer vision techniques to enhance human–robot interaction. The system employs state-of-the-art computer vision models, YOLOv7 and YOLOv8, for precise tool detection and gesture recognition, enabling the robot to seamlessly interpret operator commands and hand over tools based on gestural cues. The primary objective is to facilitate intuitive, non-verbal control of the robot, improving collaboration between human operators and robots in dynamic work environments. The results show that this approach enhances the efficiency and reliability of human–robot cooperation, particularly in manufacturing settings, by streamlining tasks and boosting productivity. By integrating real-time computer vision into the robot’s decision-making process, the system demonstrates heightened adaptability and responsiveness, creating the way for more natural and effective human–robot collaboration in industrial contexts.
Förderung
- APVV SK-IL-RD-23-0002: Advanced Localization Sensors and Techniques for Autonomous vehicles and Robots
Zitieren
APA
Malobický, B., Hruboš, M., Kafková, J., Krško, J., Michálik, M., Pirník, R., & Kuchár, P. (2025). Towards Seamless Human–Robot Interaction: Integrating Computer Vision for Tool Handover and Gesture-Based Control. Applied Sciences, 15(7), 3575. https://doi.org/10.3390/app15073575
Vancouver
Malobický B, Hruboš M, Kafková J, Krško J, Michálik M, Pirník R, et al. Towards Seamless Human–Robot Interaction: Integrating Computer Vision for Tool Handover and Gesture-Based Control. Applied Sciences. 2025;15(7):3575. doi:10.3390/app15073575
BibTeX
@article{Malobick2025,
author = {Malobický, Branislav and Hruboš, Marián and Kafková, Júlia and Krško, Jakub and Michálik, Mário and Pirník, Rastislav and Kuchár, Pavol},
title = {Towards Seamless Human–Robot Interaction: Integrating Computer Vision for Tool Handover and Gesture-Based Control},
journal = {Applied Sciences},
year = {2025},
volume = {15},
number = {7},
pages = {3575},
doi = {10.3390/app15073575}
}
EUVIMED