Proprioception and Exteroception of a Soft Robotic Finger Using Neuromorphic Vision-Based Sensing
Soft Robotics · 01.06.2023 · 10 (3) · 467-481
DOI: 10.1089/soro.2022.0030 ↗Kurz gefasst
Fachartikel in der Zeitschrift Soft Robotics, online erschienen am 14.10.2022. Verfasst von Omar Faris und 6 weiteren Autor:innen. Beteiligte Einrichtung: Mechanical Engineering Department, Khalifa University Center for Autonomous Robotic Systems (KUCARS), Khalifa University of Science and Technology, A…. Hauptthemen laut MEDLINE: Robotics. Die Arbeit wurde bisher 43-mal zitiert (Crossref) und nennt 46 Literaturangaben.
Abstract (Originalsprache)
Equipping soft robotic grippers with sensing and perception capabilities faces significant challenges due to their high compliance and flexibility, limiting their ability to successfully interact with the environment. In this work, we propose a sensorized soft robotic finger with embedded marker pattern that integrates a high-speed neuromorphic event-based camera to enable finger proprioception and exteroception. A learning-based approach involving a convolutional neural network is developed to process event-based heat maps and achieve specific sensing tasks. The feasibility of the sensing approach for proprioception is demonstrated by showing its ability to predict the two-dimensional deformation of three points located on the finger structure, whereas the exteroception capability is assessed in a slip detection task that can classify slip heat maps at a temporal resolution of 2 ms. Our results show that our proposed approach can enable complete sensorization of the finger for both proprioception and exteroception using a single camera without negatively affecting the finger compliance. Using such sensorized finger in robotic grippers may provide safe, adaptive, and precise grasping for handling a wide category of objects.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Mechanical Engineering Department, Khalifa University Center for Autonomous Robotic Systems (KUCARS), Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates.
- Mechanical Engineering Department, Khalifa University, Abu Dhabi, United Arab Emirates.
- School of Engineering Technology, Purdue University, West Lafayette, Indiana, USA.
- Aerospace Engineering Department, Khalifa University, Abu Dhabi, United Arab Emirates.
ORCID-Profile: Federico Renda
Zitieren
APA
Faris, O., Muthusamy, R., Renda, F., Hussain, I., Gan, D., Seneviratne, L., & Zweiri, Y. (2023). Proprioception and Exteroception of a Soft Robotic Finger Using Neuromorphic Vision-Based Sensing. Soft Robotics, 10(3), 467-481. https://doi.org/10.1089/soro.2022.0030
Vancouver
Faris O, Muthusamy R, Renda F, Hussain I, Gan D, Seneviratne L, et al. Proprioception and Exteroception of a Soft Robotic Finger Using Neuromorphic Vision-Based Sensing. Soft Robotics. 2023;10(3):467-481. doi:10.1089/soro.2022.0030
BibTeX
@article{Faris2023,
author = {Faris, Omar and Muthusamy, Rajkumar and Renda, Federico and Hussain, Irfan and Gan, Dongming and Seneviratne, Lakmal and Zweiri, Yahya},
title = {Proprioception and Exteroception of a Soft Robotic Finger Using Neuromorphic Vision-Based Sensing},
journal = {Soft Robotics},
year = {2023},
volume = {10},
number = {3},
pages = {467--481},
doi = {10.1089/soro.2022.0030}
}
EUVIMED