Neuromorphic sequence learning with an event camera on routes through vegetation
Science Robotics · 13.09.2023 · 8 (82)
DOI: 10.1126/scirobotics.adg3679 ↗Kurz gefasst
Fachartikel in der Zeitschrift Science Robotics, erschienen am 13.09.2023. Verfasst von Le Zhu und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Informatics, University of Edinburgh, EH8 9AB Edinburgh, UK. Hauptthemen laut MEDLINE: Robotics. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 109 Literaturangaben.
Abstract (Originalsprache)
For many robotics applications, it is desirable to have relatively low-power and efficient onboard solutions. We took inspiration from insects, such as ants, that are capable of learning and following routes in complex natural environments using relatively constrained sensory and neural systems. Such capabilities are particularly relevant to applications such as agricultural robotics, where visual navigation through dense vegetation remains a challenging task. In this scenario, a route is likely to have high self-similarity and be subject to changing lighting conditions and motion over uneven terrain, and the effects of wind on leaves increase the variability of the input. We used a bioinspired event camera on a terrestrial robot to collect visual sequences along routes in natural outdoor environments and applied a neural algorithm for spatiotemporal memory that is closely based on a known neural circuit in the insect brain. We show that this method is plausible to support route recognition for visual navigation and more robust than SeqSLAM when evaluated on repeated runs on the same route or routes with small lateral offsets. By encoding memory in a spiking neural network running on a neuromorphic computer, our model can evaluate visual familiarity in real time from event camera footage.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- School of Informatics, University of Edinburgh, EH8 9AB Edinburgh, UK.
- Sheffield Robotics, Department of Computer Science, University of Sheffield, S1 4DP Sheffield, UK.
ORCID-Profile: Le Zhu, Michael Mangan, Barbara Webb
Zitieren
APA
Zhu, L., Mangan, M., & Webb, B. (2023). Neuromorphic sequence learning with an event camera on routes through vegetation. Science Robotics, 8(82). https://doi.org/10.1126/scirobotics.adg3679
Vancouver
Zhu L, Mangan M, Webb B. Neuromorphic sequence learning with an event camera on routes through vegetation. Science Robotics. 2023;8(82). doi:10.1126/scirobotics.adg3679
BibTeX
@article{Zhu2023,
author = {Zhu, Le and Mangan, Michael and Webb, Barbara},
title = {Neuromorphic sequence learning with an event camera on routes through vegetation},
journal = {Science Robotics},
year = {2023},
volume = {8},
number = {82},
doi = {10.1126/scirobotics.adg3679}
}
EUVIMED