Unmanned Aerial Vehicle Path Planning in Complex Dynamic Environments Based on Deep Reinforcement Learning
Machines · 18.02.2025 · 13 (2) · 162
DOI: 10.3390/machines13020162 ↗Kurz gefasst
Fachartikel in der Zeitschrift Machines, online erschienen am 18.02.2025. Verfasst von Jiandong Liu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 70 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Science and Technology Innovation Project Fund of North China Institute of Aerospace Engineering.
Abstract (Originalsprache)
In this paper, an enhanced deep reinforcement learning approach is presented for unmanned aerial vehicles (UAVs) operating in dynamic and potentially hazardous environments. Initially, the capability to discern obstacles from visual data is achieved through the application of the Yolov8-StrongSort technique. Concurrently, a novel data storage system for deep Q-networks (DQN), named dynamic data memory (DDM), is introduced to hasten the learning process and convergence for UAVs. Furthermore, addressing the issue of UAVs’ paths veering too close to obstacles, a novel strategy employing an artificial potential field to adjust the reward function is introduced, which effectively guides the UAVs away from proximate obstacles. Rigorous simulation tests in an AirSim-based environment confirm the effectiveness of these methods. Compared to DQN, dueling DQN, M-DQN, improved Q-learning, DDM-DQN, EPF (enhanced potential field), APF-DQN, and L1-MBRL, our algorithm achieves the highest success rate of 77.67%, while also having the lowest average number of moving steps. Additionally, we conducted obstacle avoidance experiments with UAVs with different densities of obstacles. These tests highlight fast learning convergence and real-time obstacle detection and avoidance, ensuring successful achievement of the target.
Förderung
- Science and Technology Innovation Project Fund of North China Institute of Aerospace Engineering
Zitieren
APA
Liu, J., Luo, W., Zhang, G., & Li, R. (2025). Unmanned Aerial Vehicle Path Planning in Complex Dynamic Environments Based on Deep Reinforcement Learning. Machines, 13(2), 162. https://doi.org/10.3390/machines13020162
Vancouver
Liu J, Luo W, Zhang G, Li R. Unmanned Aerial Vehicle Path Planning in Complex Dynamic Environments Based on Deep Reinforcement Learning. Machines. 2025;13(2):162. doi:10.3390/machines13020162
BibTeX
@article{Liu2025,
author = {Liu, Jiandong and Luo, Wei and Zhang, Guoqing and Li, Ruihao},
title = {Unmanned Aerial Vehicle Path Planning in Complex Dynamic Environments Based on Deep Reinforcement Learning},
journal = {Machines},
year = {2025},
volume = {13},
number = {2},
pages = {162},
doi = {10.3390/machines13020162}
}
EUVIMED