EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Towards Seamless Human–Robot Interaction: Integrating Computer Vision for Tool Handover and Gesture-Based Control

Branislav Malobický, Marián Hruboš, Júlia Kafková, Jakub Krško, Mário Michálik, Rastislav Pirník, Pavol Kuchár

Applied Sciences · 25.03.2025 · 15 (7) · 3575

DOI: 10.3390/app15073575 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 25.03.2025. Verfasst von Branislav Malobický und 6 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: APVV SK-IL-RD-23-0002: Advanced Localization Sensors and Techniques for Autonomous vehicles and Robots.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper presents the development of a robotic workstation that integrates a collaborative robot as an assistant, leveraging advanced computer vision techniques to enhance human–robot interaction. The system employs state-of-the-art computer vision models, YOLOv7 and YOLOv8, for precise tool detection and gesture recognition, enabling the robot to seamlessly interpret operator commands and hand over tools based on gestural cues. The primary objective is to facilitate intuitive, non-verbal control of the robot, improving collaboration between human operators and robots in dynamic work environments. The results show that this approach enhances the efficiency and reliability of human–robot cooperation, particularly in manufacturing settings, by streamlining tasks and boosting productivity. By integrating real-time computer vision into the robot’s decision-making process, the system demonstrates heightened adaptability and responsiveness, creating the way for more natural and effective human–robot collaboration in industrial contexts.

Förderung

  • APVV SK-IL-RD-23-0002: Advanced Localization Sensors and Techniques for Autonomous vehicles and Robots

Zitieren

APA

Malobický, B., Hruboš, M., Kafková, J., Krško, J., Michálik, M., Pirník, R., & Kuchár, P. (2025). Towards Seamless Human–Robot Interaction: Integrating Computer Vision for Tool Handover and Gesture-Based Control. Applied Sciences, 15(7), 3575. https://doi.org/10.3390/app15073575

Vancouver

Malobický B, Hruboš M, Kafková J, Krško J, Michálik M, Pirník R, et al. Towards Seamless Human–Robot Interaction: Integrating Computer Vision for Tool Handover and Gesture-Based Control. Applied Sciences. 2025;15(7):3575. doi:10.3390/app15073575

BibTeX
@article{Malobick2025,
  author = {Malobický, Branislav and Hruboš, Marián and Kafková, Júlia and Krško, Jakub and Michálik, Mário and Pirník, Rastislav and Kuchár, Pavol},
  title = {Towards Seamless Human–Robot Interaction: Integrating Computer Vision for Tool Handover and Gesture-Based Control},
  journal = {Applied Sciences},
  year = {2025},
  volume = {15},
  number = {7},
  pages = {3575},
  doi = {10.3390/app15073575}
}
Kostenlos starten →