Adaptive visual–tactile fusion recognition for robotic operation of multi-material system
Frontiers in Neurorobotics · 20.06.2023 · 17
DOI: 10.3389/fnbot.2023.1181383 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Neurorobotics, online erschienen am 20.06.2023. Verfasst von Zihao Ding und 3 weiteren Autor:innen. Beteiligte Einrichtung: The Jiangsu Provincial Key Laboratory of Advanced Robotics, Soochow University, Suzhou, China. Die Arbeit wurde bisher 20-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program of China.
Abstract (Originalsprache)
The use of robots in various industries is evolving from mechanization to intelligence and precision. These systems often comprise parts made of different materials and thus require accurate and comprehensive target identification. While humans perceive the world through a highly diverse perceptual system and can rapidly identify deformable objects through vision and touch to prevent slipping or excessive deformation during grasping, robot recognition technology mainly relies on visual sensors, which lack critical information such as object material, leading to incomplete cognition. Therefore, multimodal information fusion is believed to be key to the development of robot recognition. Firstly, a method of converting tactile sequences to images is proposed to deal with the obstacles of information exchange between different modalities for vision and touch, which overcomes the problems of the noise and instability of tactile data. Subsequently, a visual-tactile fusion network framework based on an adaptive dropout algorithm is constructed, together with an optimal joint mechanism between visual information and tactile information established, to solve the problem of mutual exclusion or unbalanced fusion in traditional fusion methods. Finally, experiments show that the proposed method effectively improves robot recognition ability, and the classification accuracy is as high as 99.3%.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- The Jiangsu Provincial Key Laboratory of Advanced Robotics, Soochow University, Suzhou, China.
Förderung
- National Key Research and Development Program of China
Zitieren
APA
Ding, Z., Chen, G., Wang, Z., & Sun, L. (2023). Adaptive visual–tactile fusion recognition for robotic operation of multi-material system. Frontiers in Neurorobotics, 17. https://doi.org/10.3389/fnbot.2023.1181383
Vancouver
Ding Z, Chen G, Wang Z, Sun L. Adaptive visual–tactile fusion recognition for robotic operation of multi-material system. Frontiers in Neurorobotics. 2023;17. doi:10.3389/fnbot.2023.1181383
BibTeX
@article{Ding2023,
author = {Ding, Zihao and Chen, Guodong and Wang, Zhenhua and Sun, Lining},
title = {Adaptive visual–tactile fusion recognition for robotic operation of multi-material system},
journal = {Frontiers in Neurorobotics},
year = {2023},
volume = {17},
doi = {10.3389/fnbot.2023.1181383}
}
EUVIMED