Optimizing Spatial State Representation in Reinforcement Learning for Coverage Path Planning in UAV Search Missions
Drones · 05.06.2026 · 10 (6) · 442
DOI: 10.3390/drones10060442 ↗Kurz gefasst
Fachartikel in der Zeitschrift Drones, online erschienen am 05.06.2026. Verfasst von Hu Yuan und 5 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: China Postdoctoral Science Foundation.
Abstract (Originalsprache)
To enhance path planning efficiency in unmanned aerial vehicle (UAV) search missions in complex environments, this paper proposes a coverage path planning (CPP) algorithm for a UAV that integrates the deep Q-network (DQN) with the A* algorithm (DQN-A*). In the proposed DQN-A* algorithm, a dual-driven reward mechanism is established, comprising a probability-weighted reward and a step-dependent reward, steering the UAV toward high-probability regions. Furthermore, to handle previously unknown obstacles in real time, the algorithm employs a multi-stage obstacle-identification strategy, enabling the UAV to improve coverage of traversable cells by dynamically adjusting its local path when newly detected obstacles are encountered. A theoretical analysis derives a principled recommended range for the UAV positional identifier based on statistical feature analysis; this range is then validated through extensive simulations. Additionally, Hamiltonian path pre-training is introduced to accelerate convergence. Comparative simulations demonstrate that the proposed DQN-A* algorithm achieves higher area-coverage and target-detection probabilities than benchmark algorithms in environments with unknown obstacles, offering valuable insights for positional encoding in deep reinforcement learning (DRL)-based robotic coverage problems.
Förderung
- China Postdoctoral Science Foundation
Zitieren
APA
Yuan, H., Yan, S., Liu, Z., Wang, S., Wang, Q., & Chen, G. (2026). Optimizing Spatial State Representation in Reinforcement Learning for Coverage Path Planning in UAV Search Missions. Drones, 10(6), 442. https://doi.org/10.3390/drones10060442
Vancouver
Yuan H, Yan S, Liu Z, Wang S, Wang Q, Chen G. Optimizing Spatial State Representation in Reinforcement Learning for Coverage Path Planning in UAV Search Missions. Drones. 2026;10(6):442. doi:10.3390/drones10060442
BibTeX
@article{Yuan2026,
author = {Yuan, Hu and Yan, Shengkai and Liu, Zhuzhi and Wang, Suli and Wang, Qiang and Chen, Gaocheng},
title = {Optimizing Spatial State Representation in Reinforcement Learning for Coverage Path Planning in UAV Search Missions},
journal = {Drones},
year = {2026},
volume = {10},
number = {6},
pages = {442},
doi = {10.3390/drones10060442}
}
EUVIMED