EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

An Intelligent Algorithm for USVs Collision Avoidance Based on Deep Reinforcement Learning Approach with Navigation Characteristics

Zhe Sun, Yunsheng Fan, Guofeng Wang

Journal of Marine Science and Engineering · 11.04.2023 · 11 (4) · 812

DOI: 10.3390/jmse11040812 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Marine Science and Engineering, online erschienen am 11.04.2023. Verfasst von Zhe Sun und 2 weiteren Autor:innen. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Key Development Guidance Program of Liaoning Province of China, Pilot Base Construction and Pilot Verification Plan Program of Liaoning Province of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Many achievements toward unmanned surface vehicles have been made using artificial intelligence theory to assist the decisions of the navigator. In particular, there has been rapid development in autonomous collision avoidance techniques that employ the intelligent algorithm of deep reinforcement learning. A novel USV collision avoidance algorithm based on deep reinforcement learning theory for real-time maneuvering is proposed. Many improvements toward the autonomous learning framework are carried out to improve the performance of USV collision avoidance, including prioritized experience replay, noisy network, double learning, and dueling architecture, which can significantly enhance the training effect. Additionally, considering the characteristics of the USV collision avoidance problem, two effective methods to enhance training efficiency are proposed. For better training, considering the international regulations for preventing collisions at sea and USV maneuverability, a complete and reliable USV collision avoidance training system is established, demonstrating an efficient learning process in complex encounter situations. A reward signal system in line with the USV characteristics is designed. Based on the Unity maritime virtual simulation platform, an abundant simulation environment for training and testing is designed. Through detailed analysis, verification, and comparison, the improved algorithm outperforms the pre-improved algorithm in terms of stability, average reward, rules learning, and collision avoidance effect, reducing 26.60% more accumulated course deviation and saving 1.13% more time.

Förderung

  • National Natural Science Foundation of China
  • Key Development Guidance Program of Liaoning Province of China
  • Pilot Base Construction and Pilot Verification Plan Program of Liaoning Province of China
  • China Postdoctoral Science Foundation

Zitieren

APA

Sun, Z., Fan, Y., & Wang, G. (2023). An Intelligent Algorithm for USVs Collision Avoidance Based on Deep Reinforcement Learning Approach with Navigation Characteristics. Journal of Marine Science and Engineering, 11(4), 812. https://doi.org/10.3390/jmse11040812

Vancouver

Sun Z, Fan Y, Wang G. An Intelligent Algorithm for USVs Collision Avoidance Based on Deep Reinforcement Learning Approach with Navigation Characteristics. Journal of Marine Science and Engineering. 2023;11(4):812. doi:10.3390/jmse11040812

BibTeX
@article{Sun2023,
  author = {Sun, Zhe and Fan, Yunsheng and Wang, Guofeng},
  title = {An Intelligent Algorithm for USVs Collision Avoidance Based on Deep Reinforcement Learning Approach with Navigation Characteristics},
  journal = {Journal of Marine Science and Engineering},
  year = {2023},
  volume = {11},
  number = {4},
  pages = {812},
  doi = {10.3390/jmse11040812}
}
Kostenlos starten →