EUVIMEDEUVIMED entdecken
Crossref

Local 2-D Path Planning of Unmanned Underwater Vehicles in Continuous Action Space Based on the Twin-Delayed Deep Deterministic Policy Gradient

Zhenzhong Chu, Yu Wang, Daqi Zhu

IEEE Transactions on Systems, Man, and Cybernetics: Systems · 2024-05 · 54 (5) · 2775-2785

DOI: 10.1109/tsmc.2023.3348827 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2024-05. Verfasst von Zhenzhong Chu und 2 weiteren Autor:innen. Die Arbeit wurde bisher 34-mal zitiert (Crossref) und nennt 51 Literaturangaben. Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In this article, the local two-dimensional (2-D) path planning problem is studied for an unmanned underwater vehicle (UUV) under continuous action space, and an improved algorithm is proposed based on the twin-delayed deep deterministic policy gradient (TD3). The mean function is added to the policy gradient to bring the output action of the algorithm closer to the mean of the action space. Hence, it suppresses the trend of a large number of boundary actions output by the TD3 algorithm. Based on the experience replay buffer, action storage is constructed to realize the automatic adjustment of the weight coefficient. Therefore, it reduces the additional hyperparameter tuning work caused by the change in the structure of the algorithm. In the setting of environmental variables and reward functions, real-time sonar variables are added to make the algorithm model more consistent with the actual underwater navigation situation. Based on ROS, a simulation environment is built and used to verify the path planning performance of the proposed algorithm.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Chu, Z., Wang, Y., & Zhu, D. (2024). Local 2-D Path Planning of Unmanned Underwater Vehicles in Continuous Action Space Based on the Twin-Delayed Deep Deterministic Policy Gradient. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 54(5), 2775-2785. https://doi.org/10.1109/tsmc.2023.3348827

Vancouver

Chu Z, Wang Y, Zhu D. Local 2-D Path Planning of Unmanned Underwater Vehicles in Continuous Action Space Based on the Twin-Delayed Deep Deterministic Policy Gradient. IEEE Transactions on Systems, Man, and Cybernetics: Systems. 2024;54(5):2775-2785. doi:10.1109/tsmc.2023.3348827

BibTeX
@article{Chu2024,
  author = {Chu, Zhenzhong and Wang, Yu and Zhu, Daqi},
  title = {Local 2-D Path Planning of Unmanned Underwater Vehicles in Continuous Action Space Based on the Twin-Delayed Deep Deterministic Policy Gradient},
  journal = {IEEE Transactions on Systems, Man, and Cybernetics: Systems},
  year = {2024},
  volume = {54},
  number = {5},
  pages = {2775--2785},
  doi = {10.1109/tsmc.2023.3348827}
}
Kostenlos starten →