EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Model-Based AUV Path Planning Using Curriculum Learning and Deep Reinforcement Learning on a Simplified Electronic Navigation Chart

Łukasz Marchel, Rafał Kot, Piotr Szymak, Paweł Piskur

Applied Sciences · 28.05.2025 · 15 (11) · 6081

DOI: 10.3390/app15116081 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 28.05.2025. Verfasst von Łukasz Marchel und 3 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 66 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deep Reinforcement Learning (DRL)-based algorithms have demonstrated substantial effectiveness in tackling complex control problems for autonomous underwater vehicles (AUVs). This paper attempts to evaluate reinforcement learning (RL)-based methods for AUV trajectory planning by incorporating a model of a vehicle’s full motion. In this study, the agent (AUV) is assumed to have no prior knowledge of the environment in which it navigates. Instead, it only receives inputs from navigation sensors and a simulated sonar. Additionally, in the article, a reward function is proposed and described, along with its optimization process, to elicit the desired behaviors in the underwater vehicle. The models are trained and tested on simplified electronic navigation chart (ENC) maps, followed by a comparative analysis against five effective classical methods for trajectory planning. The proposed solution enables efficient, collision-free route planning for the autonomous underwater vehicle, taking its motion dynamics into account to reach the designated target successfully.

Zitieren

APA

Marchel, Ł., Kot, R., Szymak, P., & Piskur, P. (2025). Model-Based AUV Path Planning Using Curriculum Learning and Deep Reinforcement Learning on a Simplified Electronic Navigation Chart. Applied Sciences, 15(11), 6081. https://doi.org/10.3390/app15116081

Vancouver

Marchel Ł, Kot R, Szymak P, Piskur P. Model-Based AUV Path Planning Using Curriculum Learning and Deep Reinforcement Learning on a Simplified Electronic Navigation Chart. Applied Sciences. 2025;15(11):6081. doi:10.3390/app15116081

BibTeX
@article{Marchel2025,
  author = {Marchel, Łukasz and Kot, Rafał and Szymak, Piotr and Piskur, Paweł},
  title = {Model-Based AUV Path Planning Using Curriculum Learning and Deep Reinforcement Learning on a Simplified Electronic Navigation Chart},
  journal = {Applied Sciences},
  year = {2025},
  volume = {15},
  number = {11},
  pages = {6081},
  doi = {10.3390/app15116081}
}
Kostenlos starten →