EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Autonomous Navigation Decision-Making Method for a Smart Marine Surface Vessel Based on an Improved Soft Actor–Critic Algorithm

Zhewen Cui, Wei Guan, Xianku Zhang, Cheng Zhang

Journal of Marine Science and Engineering · 05.08.2023 · 11 (8) · 1554

DOI: 10.3390/jmse11081554 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Marine Science and Engineering, online erschienen am 05.08.2023. Verfasst von Zhewen Cui und 3 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Dalian Innovation Team Support Plan in the Key Research Field.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In this study, an intelligent hybrid algorithm based on deep-reinforcement learning (DRL) is proposed to achieve autonomous navigation and intelligent collision avoidance for a smart autonomous marine surface vessel (SMASV). First, the kinematic model of the SMASV is used, and clauses 13 to 17 of the Convention on the International Regulations for Preventing Collisions at Sea (COLREGs) are introduced. Then, the electronic chart is rasterized and used for path planning. Next, states, actions, and reward functions are designed, and collision avoidance strategies are formulated. In addition, a temperature factor and a constrained loss function are used to improve the soft actor–critic (SAC) algorithm. This improvement reduces the challenges of hyperparameter adjustment and improves sampling efficiency. By comparing the improved SAC algorithm with other deep-reinforcement learning (DRL) algorithms based on strategy learning, it is proved that the improved SAC algorithm converges faster than the other algorithms. During the experiment, some unknown obstacles are added to the simulation environment to verify the collision-avoidance ability of the trained SMASV. Moreover, eight sea areas are randomly selected to verify the generalization ability of the intelligent-navigation system. The results show that the proposed method can plan a path for the SMASV accurately and effectively, and the SMASV decision-making behavior in the collision-avoidance process conforms to the COLREGs in both unknown and dynamic environments.

Förderung

  • National Natural Science Foundation of China
  • Dalian Innovation Team Support Plan in the Key Research Field

Zitieren

APA

Cui, Z., Guan, W., Zhang, X., & Zhang, C. (2023). Autonomous Navigation Decision-Making Method for a Smart Marine Surface Vessel Based on an Improved Soft Actor–Critic Algorithm. Journal of Marine Science and Engineering, 11(8), 1554. https://doi.org/10.3390/jmse11081554

Vancouver

Cui Z, Guan W, Zhang X, Zhang C. Autonomous Navigation Decision-Making Method for a Smart Marine Surface Vessel Based on an Improved Soft Actor–Critic Algorithm. Journal of Marine Science and Engineering. 2023;11(8):1554. doi:10.3390/jmse11081554

BibTeX
@article{Cui2023,
  author = {Cui, Zhewen and Guan, Wei and Zhang, Xianku and Zhang, Cheng},
  title = {Autonomous Navigation Decision-Making Method for a Smart Marine Surface Vessel Based on an Improved Soft Actor–Critic Algorithm},
  journal = {Journal of Marine Science and Engineering},
  year = {2023},
  volume = {11},
  number = {8},
  pages = {1554},
  doi = {10.3390/jmse11081554}
}
Kostenlos starten →