EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Enhancing Visual Feedback Control through Early Fusion Deep Learning

Adrian-Paul Botezatu iD, Lavinia-Eugenia Ferariu iD, Adrian Burlacu iD

Entropy · 25.09.2023 · 25 (10) · 1378

DOI: 10.3390/e25101378 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Entropy, online erschienen am 25.09.2023. Verfasst von Adrian-Paul Botezatu und 2 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Automatic Control and Computer Engineering, "Gheorghe Asachi" Technical University of Iasi, D. Mangeron 27, 700050 Iasi, Romania. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

A visual servoing system is a type of control system used in robotics that employs visual feedback to guide the movement of a robot or a camera to achieve a desired task. This problem is addressed using deep models that receive a visual representation of the current and desired scene, to compute the control input. The focus is on early fusion, which consists of using additional information integrated into the neural input array. In this context, we discuss how ready-to-use information can be directly obtained from the current and desired scenes, to facilitate the learning process. Inspired by some of the most effective traditional visual servoing techniques, we introduce early fusion based on image moments and provide an extensive analysis of approaches based on image moments, region-based segmentation, and feature points. These techniques are applied stand-alone or in combination, to allow obtaining maps with different levels of detail. The role of the extra maps is experimentally investigated for scenes with different layouts. The results show that early fusion facilitates a more accurate approximation of the linear and angular camera velocities, in order to control the movement of a 6-degree-of-freedom robot from a current configuration to a desired one. The best results were obtained for the extra maps providing details of low and medium levels.

Schlagwörter

Stichwörter der Autor:innen

convolutional neural networkearly fusionfeature pointsimage momentssegmentationvisual feedback control

Autor:innen und Institutionen

  • Faculty of Automatic Control and Computer Engineering, "Gheorghe Asachi" Technical University of Iasi, D. Mangeron 27, 700050 Iasi, Romania.

ORCID-Profile: Adrian-Paul Botezatu, Lavinia-Eugenia Ferariu, Adrian Burlacu

Zitieren

APA

Botezatu, A. P., Ferariu, L. E., & Burlacu, A. (2023). Enhancing Visual Feedback Control through Early Fusion Deep Learning. Entropy, 25(10), 1378. https://doi.org/10.3390/e25101378

Vancouver

Botezatu AP, Ferariu LE, Burlacu A. Enhancing Visual Feedback Control through Early Fusion Deep Learning. Entropy. 2023;25(10):1378. doi:10.3390/e25101378

BibTeX
@article{Botezatu2023,
  author = {Botezatu, Adrian-Paul and Ferariu, Lavinia-Eugenia and Burlacu, Adrian},
  title = {Enhancing Visual Feedback Control through Early Fusion Deep Learning},
  journal = {Entropy},
  year = {2023},
  volume = {25},
  number = {10},
  pages = {1378},
  doi = {10.3390/e25101378}
}
Kostenlos starten →