Path Planning in Complex Environments Using Attention-Based Deep Deterministic Policy Gradient
Electronics · 20.09.2024 · 13 (18) · 3746
DOI: 10.3390/electronics13183746 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 20.09.2024. Verfasst von Jinlong Chen und 3 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Guangxi Science and Technology Development Project, National Natural Science Foundation of China (NSFC), Beijing Natural Science Foundation.
Abstract (Originalsprache)
The traditional Deep Deterministic Policy Gradient (DDPG) algorithm frequently exhibits a notable reduction in success rate when transferred to new environments after being trained in complex simulation settings. To address these issues, this paper adopts a Multi-Environment (Multi-Env) parallel training approach and integrates Multi-Head Attention (MHA) and Prioritized Experience Replay (PER) into the DDPG framework, optimizing the reward function to form the MAP-DDPG algorithm. This approach enhances the algorithm’s generalization capability and execution efficiency. Through comparative training and testing of the DDPG and MAP-DDPG algorithms in both simulation and real-world environments, the experimental results demonstrate that MAP-DDPG significantly improves generalization and execution efficiency over the DDPG algorithm. Specifically, in simulation environment tests, the MAP-DDPG algorithm achieved an average 30% increase in success rate and reduced the average time to reach the target point by 23.7 s compared to the DDPG algorithm. These results indicate that the MAP-DDPG algorithm significantly enhances path planning generalization and execution efficiency, providing a more effective solution for path planning in complex environments.
Förderung
- Guangxi Science and Technology Development Project
- National Natural Science Foundation of China (NSFC)
- Beijing Natural Science Foundation
- Hebei Natural Science Foundation
Zitieren
APA
Chen, J., Jiang, Y., Pan, H., & Yang, M. (2024). Path Planning in Complex Environments Using Attention-Based Deep Deterministic Policy Gradient. Electronics, 13(18), 3746. https://doi.org/10.3390/electronics13183746
Vancouver
Chen J, Jiang Y, Pan H, Yang M. Path Planning in Complex Environments Using Attention-Based Deep Deterministic Policy Gradient. Electronics. 2024;13(18):3746. doi:10.3390/electronics13183746
BibTeX
@article{Chen2024,
author = {Chen, Jinlong and Jiang, Yun and Pan, Hongren and Yang, Minghao},
title = {Path Planning in Complex Environments Using Attention-Based Deep Deterministic Policy Gradient},
journal = {Electronics},
year = {2024},
volume = {13},
number = {18},
pages = {3746},
doi = {10.3390/electronics13183746}
}
EUVIMED