EUVIMEDEUVIMED entdecken
Crossref

Proprioception and Exteroception of a Soft Robotic Finger Using Neuromorphic Vision-Based Sensing

Omar Faris, Rajkumar Muthusamy, Federico Renda iD, Irfan Hussain, Dongming Gan, Lakmal Seneviratne, Yahya Zweiri

Soft Robotics · 01.06.2023 · 10 (3) · 467-481

DOI: 10.1089/soro.2022.0030 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Soft Robotics, online erschienen am 14.10.2022. Verfasst von Omar Faris und 6 weiteren Autor:innen. Beteiligte Einrichtung: Mechanical Engineering Department, Khalifa University Center for Autonomous Robotic Systems (KUCARS), Khalifa University of Science and Technology, A…. Hauptthemen laut MEDLINE: Robotics. Die Arbeit wurde bisher 43-mal zitiert (Crossref) und nennt 46 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Equipping soft robotic grippers with sensing and perception capabilities faces significant challenges due to their high compliance and flexibility, limiting their ability to successfully interact with the environment. In this work, we propose a sensorized soft robotic finger with embedded marker pattern that integrates a high-speed neuromorphic event-based camera to enable finger proprioception and exteroception. A learning-based approach involving a convolutional neural network is developed to process event-based heat maps and achieve specific sensing tasks. The feasibility of the sensing approach for proprioception is demonstrated by showing its ability to predict the two-dimensional deformation of three points located on the finger structure, whereas the exteroception capability is assessed in a slip detection task that can classify slip heat maps at a temporal resolution of 2 ms. Our results show that our proposed approach can enable complete sensorization of the finger for both proprioception and exteroception using a single camera without negatively affecting the finger compliance. Using such sensorized finger in robotic grippers may provide safe, adaptive, and precise grasping for handling a wide category of objects.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

RoboticsFingersNeural Networks, ComputerProprioceptionHand Strength

Stichwörter der Autor:innen

deep learningexteroceptionneuromorphic vision-based sensingproprioceptionsoft finger

Autor:innen und Institutionen

  • Mechanical Engineering Department, Khalifa University Center for Autonomous Robotic Systems (KUCARS), Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates.
  • Mechanical Engineering Department, Khalifa University, Abu Dhabi, United Arab Emirates.
  • School of Engineering Technology, Purdue University, West Lafayette, Indiana, USA.
  • Aerospace Engineering Department, Khalifa University, Abu Dhabi, United Arab Emirates.

ORCID-Profile: Federico Renda

Zitieren

APA

Faris, O., Muthusamy, R., Renda, F., Hussain, I., Gan, D., Seneviratne, L., & Zweiri, Y. (2023). Proprioception and Exteroception of a Soft Robotic Finger Using Neuromorphic Vision-Based Sensing. Soft Robotics, 10(3), 467-481. https://doi.org/10.1089/soro.2022.0030

Vancouver

Faris O, Muthusamy R, Renda F, Hussain I, Gan D, Seneviratne L, et al. Proprioception and Exteroception of a Soft Robotic Finger Using Neuromorphic Vision-Based Sensing. Soft Robotics. 2023;10(3):467-481. doi:10.1089/soro.2022.0030

BibTeX
@article{Faris2023,
  author = {Faris, Omar and Muthusamy, Rajkumar and Renda, Federico and Hussain, Irfan and Gan, Dongming and Seneviratne, Lakmal and Zweiri, Yahya},
  title = {Proprioception and Exteroception of a Soft Robotic Finger Using Neuromorphic Vision-Based Sensing},
  journal = {Soft Robotics},
  year = {2023},
  volume = {10},
  number = {3},
  pages = {467--481},
  doi = {10.1089/soro.2022.0030}
}
Kostenlos starten →