Ship Collision Avoidance Decision-Making Using Multi-Agent Deep Reinforcement Learning with MMG Manoeuvring Dynamics
Journal of Marine Science and Engineering · 24.07.2026 · 14 (15) · 1359
DOI: 10.3390/jmse14151359 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Marine Science and Engineering, online erschienen am 24.07.2026. Verfasst von Junheng Zhao und 4 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, China Postdoctoral Science Foundation, Guangxi Science and Technology Program.
Abstract (Originalsprache)
With the rapid advancement of Maritime Autonomous Surface Ships (MASSs), developing intelligent decision-making systems that ensure navigation safety in complex waters has become a core priority for the maritime industry. To address the limitations of oversimplified ship dynamics, the instability in game-based strategies, and the presence of non-compliant ships in multi-ship encounters, a novel decision-making framework is developed based on Multi-Agent Deep Reinforcement Learning (MADRL). A three-degree-of-freedom (3-DOF) manoeuvring modelling group (MMG) model is incorporated to replace conventional constant-speed assumptions. By explicitly modelling the hydrodynamic forces acting on the hull, propeller, and rudder, the proposed framework captures the intrinsic coupling between the speed and heading, thereby ensuring that the generated manoeuvres conform to the physical and operational constraints. To achieve stable decision-making in multi-ship encounters, an MATD3-based decision-making module is integrated within a Centralised Training and Distributed Execution (CTDE) paradigm. This architecture enables ships to derive robust and decentralised policies, while benefiting from global information during training. In addition, the proposed method demonstrates a promising adaptability in the investigated multi-ship encounter scenarios. Simulations are conducted across a set of encounter scenarios restricted to open waters. The results demonstrate that the proposed framework achieves safe collision avoidance performance while generating COLREGs-consistent behaviours in basic encounters involving standard power-driven vessels under open-water conditions.
Förderung
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation
- Guangxi Science and Technology Program
- Key Research and Development Program of Guangxi, Zhuang Autonomous Region
- Guangxi Natural Science Foundation
- Guangxi Maritime Economy Talent Development Support Special Program
- State Key Laboratory of Maritime Technology and Safety
Zitieren
APA
Zhao, J., Liu, J., Zhang, J., Han, Z., & Tian, W. (2026). Ship Collision Avoidance Decision-Making Using Multi-Agent Deep Reinforcement Learning with MMG Manoeuvring Dynamics. Journal of Marine Science and Engineering, 14(15), 1359. https://doi.org/10.3390/jmse14151359
Vancouver
Zhao J, Liu J, Zhang J, Han Z, Tian W. Ship Collision Avoidance Decision-Making Using Multi-Agent Deep Reinforcement Learning with MMG Manoeuvring Dynamics. Journal of Marine Science and Engineering. 2026;14(15):1359. doi:10.3390/jmse14151359
BibTeX
@article{Zhao2026,
author = {Zhao, Junheng and Liu, Jiongjiong and Zhang, Jinfen and Han, Zhepeng and Tian, Wuliu},
title = {Ship Collision Avoidance Decision-Making Using Multi-Agent Deep Reinforcement Learning with MMG Manoeuvring Dynamics},
journal = {Journal of Marine Science and Engineering},
year = {2026},
volume = {14},
number = {15},
pages = {1359},
doi = {10.3390/jmse14151359}
}
EUVIMED