Deep Learning Framework for Controlling Work Sequence in Collaborative Human–Robot Assembly Processes
Sensors · 03.01.2023 · 23 (1) · 553
DOI: 10.3390/s23010553 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 03.01.2023. Verfasst von Pedro P Garcia und 3 weiteren Autor:innen. Beteiligte Einrichtung: UNIDEMI, Department of Mechanical and Industrial Engineering, NOVA School of Science and Technology, Universidade NOVA de Lisboa, 2829-516 Caparica, …. Hauptthemen laut MEDLINE: Robotics, Deep Learning. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Fundação para a Ciência e Tecnologia, Fundação para a Ciência e a Tecnologia (FCT-MCTES).
Abstract (Originalsprache)
The human–robot collaboration (HRC) solutions presented so far have the disadvantage that the interaction between humans and robots is based on the human’s state or on specific gestures purposely performed by the human, thus increasing the time required to perform a task and slowing down the pace of human labor, making such solutions uninteresting. In this study, a different concept of the HRC system is introduced, consisting of an HRC framework for managing assembly processes that are executed simultaneously or individually by humans and robots. This HRC framework based on deep learning models uses only one type of data, RGB camera data, to make predictions about the collaborative workspace and human action, and consequently manage the assembly process. To validate the HRC framework, an industrial HRC demonstrator was built to assemble a mechanical component. Four different HRC frameworks were created based on the convolutional neural network (CNN) model structures: Faster R-CNN ResNet-50 and ResNet-101, YOLOv2 and YOLOv3. The HRC framework with YOLOv3 structure showed the best performance, showing a mean average performance of 72.26% and allowed the HRC industrial demonstrator to successfully complete all assembly tasks within a desired time window. The HRC framework has proven effective for industrial assembly applications.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- UNIDEMI, Department of Mechanical and Industrial Engineering, NOVA School of Science and Technology, Universidade NOVA de Lisboa, 2829-516 Caparica, Portugal.
- Laboratório Associado de Sistemas Inteligentes, LASI, 4800-058 Guimarães, Portugal.
ORCID-Profile: Telmo G Santos, Miguel A Machado, Nuno Mendes
Förderung
- Fundação para a Ciência e Tecnologia
- Fundação para a Ciência e a Tecnologia (FCT-MCTES)
Zitieren
APA
Garcia, P. P., Santos, T. G., Machado, M. A., & Mendes, N. (2023). Deep Learning Framework for Controlling Work Sequence in Collaborative Human–Robot Assembly Processes. Sensors, 23(1), 553. https://doi.org/10.3390/s23010553
Vancouver
Garcia PP, Santos TG, Machado MA, Mendes N. Deep Learning Framework for Controlling Work Sequence in Collaborative Human–Robot Assembly Processes. Sensors. 2023;23(1):553. doi:10.3390/s23010553
BibTeX
@article{Garcia2023,
author = {Garcia, Pedro P and Santos, Telmo G and Machado, Miguel A and Mendes, Nuno},
title = {Deep Learning Framework for Controlling Work Sequence in Collaborative Human–Robot Assembly Processes},
journal = {Sensors},
year = {2023},
volume = {23},
number = {1},
pages = {553},
doi = {10.3390/s23010553}
}
EUVIMED