Autonomous Navigation Decision-Making Method for a Smart Marine Surface Vessel Based on an Improved Soft Actor–Critic Algorithm
Journal of Marine Science and Engineering · 05.08.2023 · 11 (8) · 1554
DOI: 10.3390/jmse11081554 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Marine Science and Engineering, online erschienen am 05.08.2023. Verfasst von Zhewen Cui und 3 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Dalian Innovation Team Support Plan in the Key Research Field.
Abstract (Originalsprache)
In this study, an intelligent hybrid algorithm based on deep-reinforcement learning (DRL) is proposed to achieve autonomous navigation and intelligent collision avoidance for a smart autonomous marine surface vessel (SMASV). First, the kinematic model of the SMASV is used, and clauses 13 to 17 of the Convention on the International Regulations for Preventing Collisions at Sea (COLREGs) are introduced. Then, the electronic chart is rasterized and used for path planning. Next, states, actions, and reward functions are designed, and collision avoidance strategies are formulated. In addition, a temperature factor and a constrained loss function are used to improve the soft actor–critic (SAC) algorithm. This improvement reduces the challenges of hyperparameter adjustment and improves sampling efficiency. By comparing the improved SAC algorithm with other deep-reinforcement learning (DRL) algorithms based on strategy learning, it is proved that the improved SAC algorithm converges faster than the other algorithms. During the experiment, some unknown obstacles are added to the simulation environment to verify the collision-avoidance ability of the trained SMASV. Moreover, eight sea areas are randomly selected to verify the generalization ability of the intelligent-navigation system. The results show that the proposed method can plan a path for the SMASV accurately and effectively, and the SMASV decision-making behavior in the collision-avoidance process conforms to the COLREGs in both unknown and dynamic environments.
Förderung
- National Natural Science Foundation of China
- Dalian Innovation Team Support Plan in the Key Research Field
Zitieren
APA
Cui, Z., Guan, W., Zhang, X., & Zhang, C. (2023). Autonomous Navigation Decision-Making Method for a Smart Marine Surface Vessel Based on an Improved Soft Actor–Critic Algorithm. Journal of Marine Science and Engineering, 11(8), 1554. https://doi.org/10.3390/jmse11081554
Vancouver
Cui Z, Guan W, Zhang X, Zhang C. Autonomous Navigation Decision-Making Method for a Smart Marine Surface Vessel Based on an Improved Soft Actor–Critic Algorithm. Journal of Marine Science and Engineering. 2023;11(8):1554. doi:10.3390/jmse11081554
BibTeX
@article{Cui2023,
author = {Cui, Zhewen and Guan, Wei and Zhang, Xianku and Zhang, Cheng},
title = {Autonomous Navigation Decision-Making Method for a Smart Marine Surface Vessel Based on an Improved Soft Actor–Critic Algorithm},
journal = {Journal of Marine Science and Engineering},
year = {2023},
volume = {11},
number = {8},
pages = {1554},
doi = {10.3390/jmse11081554}
}
EUVIMED