EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Unmanned Ground Vehicle Path Planning Based on Improved DRL Algorithm

Lisang Liu, Jionghui Chen, Youyuan Zhang, Jiayu Chen, Jingrun Liang, Dongwei He

Electronics · 25.06.2024 · 13 (13) · 2479

DOI: 10.3390/electronics13132479 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 25.06.2024. Verfasst von Lisang Liu und 5 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Fujian University Industry–University-Research Joint Innovation Project, Fujian University Industry–University Cooperation Science and Technology Program.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Path planning and obstacle avoidance are fundamental problems in unmanned ground vehicle path planning. Aiming at the limitations of Deep Reinforcement Learning (DRL) algorithms in unmanned ground vehicle path planning, such as low sampling rate, insufficient exploration, and unstable training, this paper proposes an improved algorithm called Dual Priority Experience and Ornstein–Uhlenbeck Soft Actor-Critic (DPEOU-SAC) based on Ornstein–Uhlenbeck (OU noise) and double-factor prioritized sampling experience replay (DPE) with the introduction of expert experience, which is used to help the agent achieve faster and better path planning and obstacle avoidance. Firstly, OU noise enhances the agent’s action selection quality through temporal correlation, thereby improving the agent’s detection performance in complex unknown environments. Meanwhile, the experience replay is based on double-factor preferential sampling, which has better sample continuity and sample utilization. Then, the introduced expert experience can help the agent to find the optimal path with faster training speed and avoid falling into a local optimum, thus achieving stable training. Finally, the proposed DPEOU-SAC algorithm is tested against other deep reinforcement learning algorithms in four different simulation environments. The experimental results show that the convergence speed of DPEOU-SAC is 88.99% higher than the traditional SAC algorithm, and the shortest path length of DPEOU-SAC is 27.24, which is shorter than that of SAC.

Förderung

  • Fujian University Industry–University-Research Joint Innovation Project
  • Fujian University Industry–University Cooperation Science and Technology Program

Zitieren

APA

Liu, L., Chen, J., Zhang, Y., Chen, J., Liang, J., & He, D. (2024). Unmanned Ground Vehicle Path Planning Based on Improved DRL Algorithm. Electronics, 13(13), 2479. https://doi.org/10.3390/electronics13132479

Vancouver

Liu L, Chen J, Zhang Y, Chen J, Liang J, He D. Unmanned Ground Vehicle Path Planning Based on Improved DRL Algorithm. Electronics. 2024;13(13):2479. doi:10.3390/electronics13132479

BibTeX
@article{Liu2024,
  author = {Liu, Lisang and Chen, Jionghui and Zhang, Youyuan and Chen, Jiayu and Liang, Jingrun and He, Dongwei},
  title = {Unmanned Ground Vehicle Path Planning Based on Improved DRL Algorithm},
  journal = {Electronics},
  year = {2024},
  volume = {13},
  number = {13},
  pages = {2479},
  doi = {10.3390/electronics13132479}
}
Kostenlos starten →