EUVIMEDEUVIMED entdecken
ÜbersichtsarbeitOpen Access · CC BY 4.0

Reinforcement Learning-Driven Autonomous Path Planning for Unmanned Surface Vehicles: Current Status, Challenges, and Future Prospects

Zexu Dong, Jiashu Zheng, Chenxuan Guo, Fangming Zhao, Yijie Chu, Xiaojun Chen

Sensors · 02.05.2026 · 26 (9) · 2852

DOI: 10.3390/s26092852 ↗

Kurz gefasst

Übersichtsarbeit in der Zeitschrift Sensors, online erschienen am 02.05.2026. Verfasst von Zexu Dong und 5 weiteren Autor:innen. Beteiligte Einrichtung: FedUni Information Engineering Institute, Hebei University of Science and Technology, Shijiazhuang 050018, China. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Hebei Provincial Department of Education, Hebei Education Department, Hebei University of Science and Technology.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The continuous advancement of autonomy and intelligence in marine shipping has made the safe and efficient navigation of unmanned surface vehicles in complex waters a major research focus. As a key link of the autonomous decision-making system for unmanned surface vehicles (USVs), local path planning needs to achieve real-time collision avoidance and motion optimization under dynamic obstacles, multiple rule constraints, and strong environmental uncertainty. In recent years, reinforcement learning has gradually become an important technical route for local path planning of USVs by virtue of its autonomous decision-making ability in high-dimensional continuous state space and adaptability to complex nonlinear problems. Combined with the evolution of the algorithm paradigm and its functional positioning in different water scenarios, this paper systematically reviews the relevant literature by examining the evolution of algorithmic paradigms; focuses on summarizing deep Q-network (DQN), Proximal Policy Optimization (PPO), Soft Actor-Critic (SAC), and Twin Delayed Deep Deterministic Policy Gradient (TD3), along with the collaborative architectures integrated with traditional planning methods such as A* and Rapidly-exploring Random Tree (RRT); and summarizes the performance characteristics, advantages, and limitations of various methods in typical scenarios. The review shows that the main bottlenecks of current research include insufficient reward mechanism design, low sample utilization efficiency, difficulty in transferring from simulation to real ships, and insufficient safety and trustworthiness verification. This paper looks forward to the future development trends from the two directions of data fusion and security enhancement in order to provide reference for related research.

Schlagwörter

Stichwörter der Autor:innen

collision avoidancedeep reinforcement learninglocal path planningreinforcement learningsim-to-real transferunmanned surface vehicles

Autor:innen und Institutionen

  • FedUni Information Engineering Institute, Hebei University of Science and Technology, Shijiazhuang 050018, China.

Förderung

  • Hebei Provincial Department of Education
  • Hebei Education Department
  • Hebei University of Science and Technology

Zitieren

APA

Dong, Z., Zheng, J., Guo, C., Zhao, F., Chu, Y., & Chen, X. (2026). Reinforcement Learning-Driven Autonomous Path Planning for Unmanned Surface Vehicles: Current Status, Challenges, and Future Prospects. Sensors, 26(9), 2852. https://doi.org/10.3390/s26092852

Vancouver

Dong Z, Zheng J, Guo C, Zhao F, Chu Y, Chen X. Reinforcement Learning-Driven Autonomous Path Planning for Unmanned Surface Vehicles: Current Status, Challenges, and Future Prospects. Sensors. 2026;26(9):2852. doi:10.3390/s26092852

BibTeX
@article{Dong2026,
  author = {Dong, Zexu and Zheng, Jiashu and Guo, Chenxuan and Zhao, Fangming and Chu, Yijie and Chen, Xiaojun},
  title = {Reinforcement Learning-Driven Autonomous Path Planning for Unmanned Surface Vehicles: Current Status, Challenges, and Future Prospects},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {9},
  pages = {2852},
  doi = {10.3390/s26092852}
}
Kostenlos starten →