EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Adaptive visual–tactile fusion recognition for robotic operation of multi-material system

Zihao Ding, Guodong Chen, Zhenhua Wang, Lining Sun

Frontiers in Neurorobotics · 20.06.2023 · 17

DOI: 10.3389/fnbot.2023.1181383 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Neurorobotics, online erschienen am 20.06.2023. Verfasst von Zihao Ding und 3 weiteren Autor:innen. Beteiligte Einrichtung: The Jiangsu Provincial Key Laboratory of Advanced Robotics, Soochow University, Suzhou, China. Die Arbeit wurde bisher 20-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The use of robots in various industries is evolving from mechanization to intelligence and precision. These systems often comprise parts made of different materials and thus require accurate and comprehensive target identification. While humans perceive the world through a highly diverse perceptual system and can rapidly identify deformable objects through vision and touch to prevent slipping or excessive deformation during grasping, robot recognition technology mainly relies on visual sensors, which lack critical information such as object material, leading to incomplete cognition. Therefore, multimodal information fusion is believed to be key to the development of robot recognition. Firstly, a method of converting tactile sequences to images is proposed to deal with the obstacles of information exchange between different modalities for vision and touch, which overcomes the problems of the noise and instability of tactile data. Subsequently, a visual-tactile fusion network framework based on an adaptive dropout algorithm is constructed, together with an optimal joint mechanism between visual information and tactile information established, to solve the problem of mutual exclusion or unbalanced fusion in traditional fusion methods. Finally, experiments show that the proposed method effectively improves robot recognition ability, and the classification accuracy is as high as 99.3%.

Schlagwörter

Stichwörter der Autor:innen

VTN modeldropoutrobotic recognitiontactile imagevisual-tactile fusion

Autor:innen und Institutionen

  • The Jiangsu Provincial Key Laboratory of Advanced Robotics, Soochow University, Suzhou, China.

Förderung

  • National Key Research and Development Program of China

Zitieren

APA

Ding, Z., Chen, G., Wang, Z., & Sun, L. (2023). Adaptive visual–tactile fusion recognition for robotic operation of multi-material system. Frontiers in Neurorobotics, 17. https://doi.org/10.3389/fnbot.2023.1181383

Vancouver

Ding Z, Chen G, Wang Z, Sun L. Adaptive visual–tactile fusion recognition for robotic operation of multi-material system. Frontiers in Neurorobotics. 2023;17. doi:10.3389/fnbot.2023.1181383

BibTeX
@article{Ding2023,
  author = {Ding, Zihao and Chen, Guodong and Wang, Zhenhua and Sun, Lining},
  title = {Adaptive visual–tactile fusion recognition for robotic operation of multi-material system},
  journal = {Frontiers in Neurorobotics},
  year = {2023},
  volume = {17},
  doi = {10.3389/fnbot.2023.1181383}
}
Kostenlos starten →