Dynamic Scene Path Planning of UAVs Based on Deep Reinforcement Learning
Drones · 2024-02-09 · 8 (2) · 60
DOI: 10.3390/drones8020060 ↗At a glance
Journal article in Drones, published online on 2024-02-09. Written by Jin Tang and 2 co-authors. Cited 66 times so far (Crossref); 34 references. The full text is freely available (open access, CC BY 4.0). Funded by: National Natural Science Foundation of China.
Abstract (original language)
Traditional unmanned aerial vehicle path planning methods focus on addressing planning issues in static scenes, struggle to balance optimality and real-time performance, and are prone to local optima. In this paper, we propose an improved deep reinforcement learning approach for UAV path planning in dynamic scenarios. Firstly, we establish a task scenario including an obstacle assessment model and model the UAV’s path planning problem using the Markov Decision Process. We translate the MDP model into the framework of reinforcement learning and design the state space, action space, and reward function while incorporating heuristic rules into the action exploration policy. Secondly, we utilize the Q function approximation of an enhanced D3QN with a prioritized experience replay mechanism and design the algorithm’s network structure based on the TensorFlow framework. Through extensive training, we obtain reinforcement learning path planning policies for both static and dynamic scenes and innovatively employ a visualized action field to analyze their planning effectiveness. Simulations demonstrate that the proposed algorithm can accomplish UAV dynamic scene path planning tasks and outperforms classical methods such as A*, RRT, and DQN in terms of planning effectiveness.
Funding
- National Natural Science Foundation of China
Cite
APA
Tang, J., Liang, Y., & Li, K. (2024). Dynamic Scene Path Planning of UAVs Based on Deep Reinforcement Learning. Drones, 8(2), 60. https://doi.org/10.3390/drones8020060
Vancouver
Tang J, Liang Y, Li K. Dynamic Scene Path Planning of UAVs Based on Deep Reinforcement Learning. Drones. 2024;8(2):60. doi:10.3390/drones8020060
BibTeX
@article{Tang2024,
author = {Tang, Jin and Liang, Yangang and Li, Kebo},
title = {Dynamic Scene Path Planning of UAVs Based on Deep Reinforcement Learning},
journal = {Drones},
year = {2024},
volume = {8},
number = {2},
pages = {60},
doi = {10.3390/drones8020060}
}
EUVIMED