Enhancing navigation performance in unknown environments using spiking neural networks and reinforcement learning with asymptotic gradient method
Complex & Intelligent Systems · 2025-02 · 11 (2)
DOI: 10.1007/s40747-024-01777-6 ↗Kurz gefasst
Fachartikel in der Zeitschrift Complex & Intelligent Systems, online erschienen am 17.01.2025. Verfasst von Xiaode Liu und 7 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Nature Science Foundation of China.
Abstract (Originalsprache)
Achieving accurate and generalized autonomous navigation in unknown environments poses a significant challenge in robotics and artificial intelligence. Animals exhibits superlative navigation capabilities by combining the representation of internal neurals and sensory cues of self-motion and external information. This paper proposes a brain-inspired navigation method based upon the spiking neural networks (SNN) and reinforcement learning, integrated with a lidar system that serves as the local environment explorer, by which realizes high performance of obstacle avoidance and target arrival in mapless circumstances. An asymptotic gradient method is introduced to optimize the backpropagation during training, which facilitates the improvement of model robustness. The results of our experiments conducted on the Gazebo platform showcase how our approach effectively improves navigation performance in various intricate environments. Our approach yielded a higher success navigation rate ranging from 2% to 5%, depending on the SNN timesteps. Considering the inherent lower computational cost of SNN, this work contributes to advancing the fusion of SNN and reinforcement learning techniques for energy-efficient autonomous navigation tasks in real-world mapless scenarios.
Förderung
- National Nature Science Foundation of China
Zitieren
APA
Liu, X., Guo, Y., Chen, Y., Zhou, J., Zhang, Y., Peng, W., Huang, X., & Ma, Z. (2025). Enhancing navigation performance in unknown environments using spiking neural networks and reinforcement learning with asymptotic gradient method. Complex & Intelligent Systems, 11(2). https://doi.org/10.1007/s40747-024-01777-6
Vancouver
Liu X, Guo Y, Chen Y, Zhou J, Zhang Y, Peng W, et al. Enhancing navigation performance in unknown environments using spiking neural networks and reinforcement learning with asymptotic gradient method. Complex & Intelligent Systems. 2025;11(2). doi:10.1007/s40747-024-01777-6
BibTeX
@article{Liu2025,
author = {Liu, Xiaode and Guo, Yufei and Chen, Yuanpei and Zhou, Jie and Zhang, Yuhan and Peng, Weihang and Huang, Xuhui and Ma, Zhe},
title = {Enhancing navigation performance in unknown environments using spiking neural networks and reinforcement learning with asymptotic gradient method},
journal = {Complex & Intelligent Systems},
year = {2025},
volume = {11},
number = {2},
doi = {10.1007/s40747-024-01777-6}
}
EUVIMED