Development of a UR5 Cobot Vision System with MLP Neural Network for Object Classification and Sorting
Information · 27.06.2025 · 16 (7) · 550
DOI: 10.3390/info16070550 ↗Kurz gefasst
Fachartikel in der Zeitschrift Information, online erschienen am 27.06.2025. Verfasst von Szymon Kluziak und 1 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: AGH University of Krakow.
Abstract (Originalsprache)
This paper presents the implementation of a vision system for a collaborative robot equipped with a web camera and a Python-based control algorithm for automated object-sorting tasks. The vision system aims to detect, classify, and manipulate objects within the robot’s workspace using only 2D camera images. The vision system was integrated with the Universal Robots UR5 cobot and designed for object sorting based on shape recognition. The software stack includes OpenCV for image processing, NumPy for numerical operations, and scikit-learn for multilayer perceptron (MLP) models. The paper outlines the calibration process, including lens distortion correction and camera-to-robot calibration in a hand-in-eye configuration to establish the spatial relationship between the camera and the cobot. Object localization relied on a virtual plane aligned with the robot’s workspace. Object classification was conducted using contour similarity with Hu moments, SIFT-based descriptors with FLANN matching, and MLP-based neural models trained on preprocessed images. Conducted performance evaluations encompassed accuracy metrics for used identification methods (MLP classifier, contour similarity, and feature descriptor matching) and the effectiveness of the vision system in controlling the cobot for sorting tasks. The evaluation focused on classification accuracy and sorting effectiveness, using sensitivity, specificity, precision, accuracy, and F1-score metrics. Results showed that neural network-based methods outperformed traditional methods in all categories, concurrently offering more straightforward implementation.
Förderung
- AGH University of Krakow
Zitieren
APA
Kluziak, S., & Kohut, P. (2025). Development of a UR5 Cobot Vision System with MLP Neural Network for Object Classification and Sorting. Information, 16(7), 550. https://doi.org/10.3390/info16070550
Vancouver
Kluziak S, Kohut P. Development of a UR5 Cobot Vision System with MLP Neural Network for Object Classification and Sorting. Information. 2025;16(7):550. doi:10.3390/info16070550
BibTeX
@article{Kluziak2025,
author = {Kluziak, Szymon and Kohut, Piotr},
title = {Development of a UR5 Cobot Vision System with MLP Neural Network for Object Classification and Sorting},
journal = {Information},
year = {2025},
volume = {16},
number = {7},
pages = {550},
doi = {10.3390/info16070550}
}
EUVIMED