A Collaborative Robotic System for Autonomous Object Handling with Natural User Interaction
Robotics · 27.02.2026 · 15 (3) · 49
DOI: 10.3390/robotics15030049 ↗Kurz gefasst
Fachartikel in der Zeitschrift Robotics, online erschienen am 27.02.2026. Verfasst von Federico Neri und 3 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 22 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
In Industry 5.0, the transition from fixed traditional automation to flexible human–robot collaboration (HRC) needs interfaces that are both intuitive and efficient. This paper introduces a novel, multimodal control system for autonomous object handling, specifically designed to enhance natural user interaction in dynamic work environments. The system integrates a 6-Degrees of Freedom (DoF) collaborative robot (UR5e) with a hand-eye RGB-D vision system to achieve robust autonomy. The core technical contribution lies in a vision pipeline utilizing deep learning for object detection and point cloud processing for accurate 6D pose estimation, enabling advanced tasks such as human-aware object handover directly onto the operator’s hand. Crucially, an Automatic Speech Recognition (ASR) is incorporated, providing a Natural Language Understanding (NLU) layer that allows operators to issue real-time commands for task modification, error correction and object selection. Experimental results demonstrate that this multimodal approach offers a streamlined workflow aiming to improve operational flexibility compared to traditional HMIs, while enhancing the perceived naturalness of the collaborative task. The system establishes a framework for highly responsive and intuitive human–robot workspaces, advancing the state of the art in natural interaction for collaborative object manipulation.
Zitieren
APA
Neri, F., Lettera, G., Palmieri, G., & Callegari, M. (2026). A Collaborative Robotic System for Autonomous Object Handling with Natural User Interaction. Robotics, 15(3), 49. https://doi.org/10.3390/robotics15030049
Vancouver
Neri F, Lettera G, Palmieri G, Callegari M. A Collaborative Robotic System for Autonomous Object Handling with Natural User Interaction. Robotics. 2026;15(3):49. doi:10.3390/robotics15030049
BibTeX
@article{Neri2026,
author = {Neri, Federico and Lettera, Gaetano and Palmieri, Giacomo and Callegari, Massimo},
title = {A Collaborative Robotic System for Autonomous Object Handling with Natural User Interaction},
journal = {Robotics},
year = {2026},
volume = {15},
number = {3},
pages = {49},
doi = {10.3390/robotics15030049}
}
EUVIMED