EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Path Planning Algorithm for Unmanned Surface Vessel Based on Multiobjective Reinforcement Learning

Caipei Yang, Yingqi Zhao, Xuan Cai, Wei Wei, Xingxing Feng, Kaibo Zhou iD

Computational Intelligence and Neuroscience · 2023

DOI: 10.1155/2023/2146314 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computational Intelligence and Neuroscience, 2023. Verfasst von Caipei Yang und 5 weiteren Autor:innen. Beteiligte Einrichtung: MOE Key Laboratory of Image Information Processing and Intelligent Control, School of Artificial Intelligence and Automation, Huazhong University of …. Hauptthemen laut MEDLINE: Learning, Reinforcement, Psychology. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Marine Defense Technology Innovation Center Innovation Fund, Knowledge Innovation Program of Wuhan-Basic Research.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

It is challenging to perform path planning tasks in complex marine environments as the unmanned surface vessel approaches the goal while avoiding obstacles. However, the conflict between the two subtarget tasks of obstacle avoidance and goal approaching makes the path planning difficult. Thus, a path planning method for unmanned surface vessel based on multiobjective reinforcement learning is proposed under the complex environment with high randomness and multiple dynamic obstacles. Firstly, the path planning scene is set as the main scene, and the two subtarget scenes including obstacle avoidance and goal approaching are divided from it. The action selection strategy in each subtarget scene is trained through the double deep Q ‐network with prioritized experience replay. A multiobjective reinforcement learning framework based on ensemble learning is further designed for policy integration in the main scene. Finally, by selecting the strategy from subtarget scenes in the designed framework, an optimized action selection strategy is trained and used for the action decision of the agent in the main scene. Compared with traditional value‐based reinforcement learning methods, the proposed method achieves a 93% success rate in path planning in simulation scenes. Furthermore, the average length of the paths planned by the proposed method is 3.28% and 1.97% shorter than that of PER‐DDQN and dueling DQN, respectively.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

LearningReinforcement, PsychologyAlgorithmsComputer SimulationPolicy

Autor:innen und Institutionen

  • MOE Key Laboratory of Image Information Processing and Intelligent Control, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, China.
  • Wuhan Second Ship Design and Research Institute, Wuhan 430205, China.

ORCID-Profile: Kaibo Zhou

Förderung

  • Marine Defense Technology Innovation Center Innovation Fund
  • Knowledge Innovation Program of Wuhan-Basic Research

Zitieren

APA

Yang, C., Zhao, Y., Cai, X., Wei, W., Feng, X., & Zhou, K. (2023). Path Planning Algorithm for Unmanned Surface Vessel Based on Multiobjective Reinforcement Learning. Computational Intelligence and Neuroscience. https://doi.org/10.1155/2023/2146314

Vancouver

Yang C, Zhao Y, Cai X, Wei W, Feng X, Zhou K. Path Planning Algorithm for Unmanned Surface Vessel Based on Multiobjective Reinforcement Learning. Computational Intelligence and Neuroscience. 2023. doi:10.1155/2023/2146314

BibTeX
@article{Yang2023,
  author = {Yang, Caipei and Zhao, Yingqi and Cai, Xuan and Wei, Wei and Feng, Xingxing and Zhou, Kaibo},
  title = {Path Planning Algorithm for Unmanned Surface Vessel Based on Multiobjective Reinforcement Learning},
  journal = {Computational Intelligence and Neuroscience},
  year = {2023},
  doi = {10.1155/2023/2146314}
}
Kostenlos starten →