Enhancing Visual Feedback Control through Early Fusion Deep Learning
Entropy · 25.09.2023 · 25 (10) · 1378
DOI: 10.3390/e25101378 ↗Kurz gefasst
Fachartikel in der Zeitschrift Entropy, online erschienen am 25.09.2023. Verfasst von Adrian-Paul Botezatu und 2 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Automatic Control and Computer Engineering, "Gheorghe Asachi" Technical University of Iasi, D. Mangeron 27, 700050 Iasi, Romania. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
A visual servoing system is a type of control system used in robotics that employs visual feedback to guide the movement of a robot or a camera to achieve a desired task. This problem is addressed using deep models that receive a visual representation of the current and desired scene, to compute the control input. The focus is on early fusion, which consists of using additional information integrated into the neural input array. In this context, we discuss how ready-to-use information can be directly obtained from the current and desired scenes, to facilitate the learning process. Inspired by some of the most effective traditional visual servoing techniques, we introduce early fusion based on image moments and provide an extensive analysis of approaches based on image moments, region-based segmentation, and feature points. These techniques are applied stand-alone or in combination, to allow obtaining maps with different levels of detail. The role of the extra maps is experimentally investigated for scenes with different layouts. The results show that early fusion facilitates a more accurate approximation of the linear and angular camera velocities, in order to control the movement of a 6-degree-of-freedom robot from a current configuration to a desired one. The best results were obtained for the extra maps providing details of low and medium levels.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Faculty of Automatic Control and Computer Engineering, "Gheorghe Asachi" Technical University of Iasi, D. Mangeron 27, 700050 Iasi, Romania.
ORCID-Profile: Adrian-Paul Botezatu, Lavinia-Eugenia Ferariu, Adrian Burlacu
Zitieren
APA
Botezatu, A. P., Ferariu, L. E., & Burlacu, A. (2023). Enhancing Visual Feedback Control through Early Fusion Deep Learning. Entropy, 25(10), 1378. https://doi.org/10.3390/e25101378
Vancouver
Botezatu AP, Ferariu LE, Burlacu A. Enhancing Visual Feedback Control through Early Fusion Deep Learning. Entropy. 2023;25(10):1378. doi:10.3390/e25101378
BibTeX
@article{Botezatu2023,
author = {Botezatu, Adrian-Paul and Ferariu, Lavinia-Eugenia and Burlacu, Adrian},
title = {Enhancing Visual Feedback Control through Early Fusion Deep Learning},
journal = {Entropy},
year = {2023},
volume = {25},
number = {10},
pages = {1378},
doi = {10.3390/e25101378}
}
EUVIMED