An Offline Reinforcement Learning Approach for Path Following of an Unmanned Surface Vehicle
Journal of Marine Science and Engineering · 28.11.2024 · 12 (12) · 2173
DOI: 10.3390/jmse12122173 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Marine Science and Engineering, online erschienen am 28.11.2024. Verfasst von Zexing Zhou und 5 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Stable Support Project of National Defense Science and Industry Bureau of China.
Abstract (Originalsprache)
Path following is crucial for enhancing the autonomy of unmanned surface vehicles (USVs) in water monitoring missions. This paper presents an offline reinforcement learning (RL) controller for USVs. The controller employs the soft actor–critic algorithm with a diversified Q-ensemble to optimize the steering control policy using a pre-collected dataset of USV path-following trials. A Markov decision process (MDP) tailored for path following is formulated. The proposed offline RL steering controller, trained on static datasets, demonstrates improved sample efficiency and asymptotic performance due to an expanded ensemble of Q-networks. The accuracy and adaptive learning capabilities of the RL controller are validated through simulations and free-running tests.
Förderung
- Stable Support Project of National Defense Science and Industry Bureau of China
Zitieren
APA
Zhou, Z., Bao, T., Ding, J., Chen, Y., Jiang, Z., & Zhang, B. (2024). An Offline Reinforcement Learning Approach for Path Following of an Unmanned Surface Vehicle. Journal of Marine Science and Engineering, 12(12), 2173. https://doi.org/10.3390/jmse12122173
Vancouver
Zhou Z, Bao T, Ding J, Chen Y, Jiang Z, Zhang B. An Offline Reinforcement Learning Approach for Path Following of an Unmanned Surface Vehicle. Journal of Marine Science and Engineering. 2024;12(12):2173. doi:10.3390/jmse12122173
BibTeX
@article{Zhou2024,
author = {Zhou, Zexing and Bao, Tao and Ding, Jun and Chen, Yihong and Jiang, Zhengyi and Zhang, Bo},
title = {An Offline Reinforcement Learning Approach for Path Following of an Unmanned Surface Vehicle},
journal = {Journal of Marine Science and Engineering},
year = {2024},
volume = {12},
number = {12},
pages = {2173},
doi = {10.3390/jmse12122173}
}
EUVIMED