EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

An Offline Reinforcement Learning Approach for Path Following of an Unmanned Surface Vehicle

Zexing Zhou, Tao Bao, Jun Ding, Yihong Chen, Zhengyi Jiang, Bo Zhang

Journal of Marine Science and Engineering · 28.11.2024 · 12 (12) · 2173

DOI: 10.3390/jmse12122173 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Marine Science and Engineering, online erschienen am 28.11.2024. Verfasst von Zexing Zhou und 5 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Stable Support Project of National Defense Science and Industry Bureau of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Path following is crucial for enhancing the autonomy of unmanned surface vehicles (USVs) in water monitoring missions. This paper presents an offline reinforcement learning (RL) controller for USVs. The controller employs the soft actor–critic algorithm with a diversified Q-ensemble to optimize the steering control policy using a pre-collected dataset of USV path-following trials. A Markov decision process (MDP) tailored for path following is formulated. The proposed offline RL steering controller, trained on static datasets, demonstrates improved sample efficiency and asymptotic performance due to an expanded ensemble of Q-networks. The accuracy and adaptive learning capabilities of the RL controller are validated through simulations and free-running tests.

Förderung

  • Stable Support Project of National Defense Science and Industry Bureau of China

Zitieren

APA

Zhou, Z., Bao, T., Ding, J., Chen, Y., Jiang, Z., & Zhang, B. (2024). An Offline Reinforcement Learning Approach for Path Following of an Unmanned Surface Vehicle. Journal of Marine Science and Engineering, 12(12), 2173. https://doi.org/10.3390/jmse12122173

Vancouver

Zhou Z, Bao T, Ding J, Chen Y, Jiang Z, Zhang B. An Offline Reinforcement Learning Approach for Path Following of an Unmanned Surface Vehicle. Journal of Marine Science and Engineering. 2024;12(12):2173. doi:10.3390/jmse12122173

BibTeX
@article{Zhou2024,
  author = {Zhou, Zexing and Bao, Tao and Ding, Jun and Chen, Yihong and Jiang, Zhengyi and Zhang, Bo},
  title = {An Offline Reinforcement Learning Approach for Path Following of an Unmanned Surface Vehicle},
  journal = {Journal of Marine Science and Engineering},
  year = {2024},
  volume = {12},
  number = {12},
  pages = {2173},
  doi = {10.3390/jmse12122173}
}
Kostenlos starten →