Swarm Cooperative Navigation Using Centralized Training and Decentralized Execution
Drones · 11.03.2023 · 7 (3) · 193
DOI: 10.3390/drones7030193 ↗Kurz gefasst
Fachartikel in der Zeitschrift Drones, online erschienen am 11.03.2023. Verfasst von Rana Azzam und 2 weiteren Autor:innen. Die Arbeit wurde bisher 38-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Khalifa University.
Abstract (Originalsprache)
The demand for autonomous UAV swarm operations has been on the rise following the success of UAVs in various challenging tasks. Yet conventional swarm control approaches are inadequate for coping with swarm scalability, computational requirements, and real-time performance. In this paper, we demonstrate the capability of emerging multi-agent reinforcement learning (MARL) approaches to successfully and efficiently make sequential decisions during UAV swarm collaborative tasks. We propose a scalable, real-time, MARL approach for UAV collaborative navigation where members of the swarm have to arrive at target locations at the same time. Centralized training and decentralized execution (CTDE) are used to achieve this, where a combination of negative and positive reinforcement is employed in the reward function. Curriculum learning is used to facilitate the sought performance, especially due to the high complexity of the problem which requires extensive exploration. A UAV model that highly resembles the respective physical platform is used for training the proposed framework to make training and testing realistic. The scalability of the platform to various swarm sizes, speeds, goal positions, environment dimensions, and UAV masses has been showcased in (1) a load drop-off scenario, and (2) UAV swarm formation without requiring any re-training or fine-tuning of the agents. The obtained simulation results have proven the effectiveness and generalizability of our proposed MARL framework for cooperative UAV navigation.
Förderung
- Khalifa University
Zitieren
APA
Azzam, R., Boiko, I., & Zweiri, Y. (2023). Swarm Cooperative Navigation Using Centralized Training and Decentralized Execution. Drones, 7(3), 193. https://doi.org/10.3390/drones7030193
Vancouver
Azzam R, Boiko I, Zweiri Y. Swarm Cooperative Navigation Using Centralized Training and Decentralized Execution. Drones. 2023;7(3):193. doi:10.3390/drones7030193
BibTeX
@article{Azzam2023,
author = {Azzam, Rana and Boiko, Igor and Zweiri, Yahya},
title = {Swarm Cooperative Navigation Using Centralized Training and Decentralized Execution},
journal = {Drones},
year = {2023},
volume = {7},
number = {3},
pages = {193},
doi = {10.3390/drones7030193}
}
EUVIMED