An Efficient Multi-AUV Cooperative Navigation Method Based on Hierarchical Reinforcement Learning
Journal of Marine Science and Engineering · 26.09.2023 · 11 (10) · 1863
DOI: 10.3390/jmse11101863 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Marine Science and Engineering, online erschienen am 26.09.2023. Verfasst von Zixiao Zhu und 6 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Shenzhen Science and Technology Program, Local Science and Technology Special fundation under the Guidance of the Central Government of Shenzhen.
Abstract (Originalsprache)
Positioning errors introduced by low-precision navigation devices can affect the overall accuracy of a positioning system. To address this issue, this paper proposes a master-slave multi-AUV collaborative navigation method based on hierarchical reinforcement learning. First, a collaborative navigation system is modeled as a discrete semi-Markov process with defined state and action sets and reward functions. Second, trajectory planning is performed using a hierarchical reinforcement learning-based approach combined with the polar Kalman filter to reduce the positioning error of slave AUVs, realizing collaborative navigation in multi-slave AUV scenarios. The proposed collaborative navigation method is analyzed and validated by simulation experiments in terms of the relative distance between the master and slave AUVs and the positioning error of a slave AUV. The research results show that the proposed method can not only successfully reduce the observation and positioning errors of slave AUVs in the collaborative navigation process but can also effectively maintain the relative measurement distance between the master and slave AUVs within an appropriate range.
Förderung
- National Natural Science Foundation of China
- Shenzhen Science and Technology Program
- Local Science and Technology Special fundation under the Guidance of the Central Government of Shenzhen
- Science and Technology on Avionics Integration Laboratory and Aeronautical Science Foundation of China
- China Postdoctoral Science Foundation
- National Research and Development Project
- National Key Research and Development Program of China
Zitieren
APA
Zhu, Z., Zhang, L., Liu, L., Wu, D., Bai, S., Ren, R., & Geng, W. (2023). An Efficient Multi-AUV Cooperative Navigation Method Based on Hierarchical Reinforcement Learning. Journal of Marine Science and Engineering, 11(10), 1863. https://doi.org/10.3390/jmse11101863
Vancouver
Zhu Z, Zhang L, Liu L, Wu D, Bai S, Ren R, et al. An Efficient Multi-AUV Cooperative Navigation Method Based on Hierarchical Reinforcement Learning. Journal of Marine Science and Engineering. 2023;11(10):1863. doi:10.3390/jmse11101863
BibTeX
@article{Zhu2023,
author = {Zhu, Zixiao and Zhang, Lichuan and Liu, Lu and Wu, Dongwei and Bai, Shuchang and Ren, Ranzhen and Geng, Wenlong},
title = {An Efficient Multi-AUV Cooperative Navigation Method Based on Hierarchical Reinforcement Learning},
journal = {Journal of Marine Science and Engineering},
year = {2023},
volume = {11},
number = {10},
pages = {1863},
doi = {10.3390/jmse11101863}
}
EUVIMED