Reinforcement Learning-Guided Particle Swarm Optimization for Multi-Objective Unmanned Aerial Vehicle Path Planning
Symmetry · 11.08.2025 · 17 (8) · 1292
DOI: 10.3390/sym17081292 ↗Kurz gefasst
Fachartikel in der Zeitschrift Symmetry, online erschienen am 11.08.2025. Verfasst von Wuke Li und 2 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Science Foundation of Hunan Province, Doctoral Research Start-up Fund Project of Hunan University of Arts and Science.
Abstract (Originalsprache)
Multi-objective Unmanned Aerial Vehicle (UAV) path planning in complex 3D environments presents a fundamental challenge requiring the simultaneous optimization of conflicting objectives such as path length, safety, altitude constraints, and smoothness. This study proposes a novel hybrid framework, termed QL-MOPSO, that integrates reinforcement learning with metaheuristic optimization through a three-stage hierarchical architecture. The framework employs Q-learning to generate a global guidance path in a discretized 2D grid environment using an eight-directional symmetric action space that embodies rotational symmetry at π/4 intervals, ensuring uniform exploration capabilities and unbiased path planning. A crucial intermediate stage transforms the discrete 2D path into a 3D initial trajectory, bridging the gap between discrete learning and continuous optimization domains. The MOPSO algorithm then performs fine-grained refinement in continuous 3D space, guided by a novel Q-learning path deviation objective that ensures continuous knowledge transfer throughout the optimization process. Experimental results demonstrate that the symmetric action space design yields 20.6% shorter paths compared to asymmetric alternatives, while the complete QL-MOPSO framework achieves 5% path length reduction and significantly faster convergence compared to standard MOPSO. The proposed method successfully generates Pareto-optimal solutions that balance multiple objectives while leveraging the symmetry-aware guidance mechanism to avoid local optima and accelerate convergence, offering a robust solution for complex multi-objective UAV path planning problems.
Förderung
- Natural Science Foundation of Hunan Province
- Doctoral Research Start-up Fund Project of Hunan University of Arts and Science
Zitieren
APA
Li, W., Xiong, Y., & Xiong, Q. (2025). Reinforcement Learning-Guided Particle Swarm Optimization for Multi-Objective Unmanned Aerial Vehicle Path Planning. Symmetry, 17(8), 1292. https://doi.org/10.3390/sym17081292
Vancouver
Li W, Xiong Y, Xiong Q. Reinforcement Learning-Guided Particle Swarm Optimization for Multi-Objective Unmanned Aerial Vehicle Path Planning. Symmetry. 2025;17(8):1292. doi:10.3390/sym17081292
BibTeX
@article{Li2025,
author = {Li, Wuke and Xiong, Ying and Xiong, Qi},
title = {Reinforcement Learning-Guided Particle Swarm Optimization for Multi-Objective Unmanned Aerial Vehicle Path Planning},
journal = {Symmetry},
year = {2025},
volume = {17},
number = {8},
pages = {1292},
doi = {10.3390/sym17081292}
}
EUVIMED