EUVIMEDEUVIMED entdecken
Crossref

Realistic Curriculum Reinforcement Learning for Autonomous and Sustainable Marine Vessel Navigation

Xiaocai Zhang, Zhe Xiao, Maohan Liang, Tao Liu, Haijiang Li, Wenbin Zhang

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (46) · 39612-39619

DOI: 10.1609/aaai.v40i46.41313 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Xiaocai Zhang und 5 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Sustainability is becoming increasingly critical in the maritime transport, encompassing both environmental and social impacts, such as Greenhouse Gas (GHG) emissions and navigational safety. Traditional vessel navigation heavily relies on human experience, often lacking autonomy and emission awareness, and is prone to human errors that may compromise safety. In this paper, we propose a Curriculum Reinforcement Learning (CRL) framework integrated with a realistic, data-driven marine simulation environment and a machine learning-based fuel consumption prediction module. The simulation environment is constructed using real-world vessel movement data and enhanced with a Diffusion Model to simulate dynamic maritime conditions. Vessel fuel consumption is estimated using historical operational data and learning-based regression. The surrounding environment is represented as image-based inputs to capture spatial complexity. We design a lightweight, policy-based CRL agent with a comprehensive reward mechanism that considers safety, emissions, timeliness, and goal completion. This framework effectively handles complex tasks progressively while ensuring stable and efficient learning in continuous action spaces. We validate the proposed approach in a sea area of the Indian Ocean, demonstrating its efficacy in enabling sustainable and safe vessel navigation.

Zitieren

APA

Zhang, X., Xiao, Z., Liang, M., Liu, T., Li, H., & Zhang, W. (2026). Realistic Curriculum Reinforcement Learning for Autonomous and Sustainable Marine Vessel Navigation. Proceedings of the AAAI Conference on Artificial Intelligence, 40(46), 39612-39619. https://doi.org/10.1609/aaai.v40i46.41313

Vancouver

Zhang X, Xiao Z, Liang M, Liu T, Li H, Zhang W. Realistic Curriculum Reinforcement Learning for Autonomous and Sustainable Marine Vessel Navigation. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(46):39612-39619. doi:10.1609/aaai.v40i46.41313

BibTeX
@article{Zhang2026,
  author = {Zhang, Xiaocai and Xiao, Zhe and Liang, Maohan and Liu, Tao and Li, Haijiang and Zhang, Wenbin},
  title = {Realistic Curriculum Reinforcement Learning for Autonomous and Sustainable Marine Vessel Navigation},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {46},
  pages = {39612--39619},
  doi = {10.1609/aaai.v40i46.41313}
}
Kostenlos starten →