EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Optimizing Multi-Vessel Collision Avoidance Decision Making for Autonomous Surface Vessels: A COLREGs-Compliant Deep Reinforcement Learning Approach

Weidong Xie, Longhui Gang, Mingheng Zhang, Tong Liu, Zhixun Lan

Journal of Marine Science and Engineering · 22.02.2024 · 12 (3) · 372

DOI: 10.3390/jmse12030372 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Marine Science and Engineering, online erschienen am 22.02.2024. Verfasst von Weidong Xie und 4 weiteren Autor:innen. Die Arbeit wurde bisher 41-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: the National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Automatic collision avoidance decision making for vessels is a critical challenge in the development of autonomous ships and has become a central point of research in the maritime safety domain. Effective and systematic collision avoidance strategies significantly reduce the risk of vessel collisions, ensuring safe navigation. This study develops a multi-vessel automatic collision avoidance decision-making method based on deep reinforcement learning (DRL) and establishes a vessel behavior decision model. When designing the reward function for continuous action spaces, the criteria of the “Convention on the International Regulations for Preventing Collisions at Sea” (COLREGs) were adhered to, taking into account the vessel’s collision risk under various encounter situations, real-world navigation practices, and navigational complexities. Furthermore, to enable the algorithm to precisely differentiate between collision avoidance and the navigation resumption phase in varied vessel encounter situations, this paper incorporated “collision avoidance decision making” and “course recovery decision making” as state parameters in the state set design, from which the respective objective functions were defined. To further enhance the algorithm’s performance, techniques such as behavior cloning, residual networks, and CPU-GPU dual-core parallel processing modules were integrated. Through simulation experiments in the enhanced Imazu training environment, the practicality of the method, taking into account the effects of wind and ocean currents, was corroborated. The results demonstrate that the proposed algorithm can perform effective collision avoidance decision making in a range of vessel encounter situations, indicating its efficiency and robust generalization capabilities.

Förderung

  • the National Natural Science Foundation of China

Zitieren

APA

Xie, W., Gang, L., Zhang, M., Liu, T., & Lan, Z. (2024). Optimizing Multi-Vessel Collision Avoidance Decision Making for Autonomous Surface Vessels: A COLREGs-Compliant Deep Reinforcement Learning Approach. Journal of Marine Science and Engineering, 12(3), 372. https://doi.org/10.3390/jmse12030372

Vancouver

Xie W, Gang L, Zhang M, Liu T, Lan Z. Optimizing Multi-Vessel Collision Avoidance Decision Making for Autonomous Surface Vessels: A COLREGs-Compliant Deep Reinforcement Learning Approach. Journal of Marine Science and Engineering. 2024;12(3):372. doi:10.3390/jmse12030372

BibTeX
@article{Xie2024,
  author = {Xie, Weidong and Gang, Longhui and Zhang, Mingheng and Liu, Tong and Lan, Zhixun},
  title = {Optimizing Multi-Vessel Collision Avoidance Decision Making for Autonomous Surface Vessels: A COLREGs-Compliant Deep Reinforcement Learning Approach},
  journal = {Journal of Marine Science and Engineering},
  year = {2024},
  volume = {12},
  number = {3},
  pages = {372},
  doi = {10.3390/jmse12030372}
}
Kostenlos starten →