EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Swarm Cooperative Navigation Using Centralized Training and Decentralized Execution

Rana Azzam, Igor Boiko, Yahya Zweiri

Drones · 11.03.2023 · 7 (3) · 193

DOI: 10.3390/drones7030193 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Drones, online erschienen am 11.03.2023. Verfasst von Rana Azzam und 2 weiteren Autor:innen. Die Arbeit wurde bisher 38-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Khalifa University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The demand for autonomous UAV swarm operations has been on the rise following the success of UAVs in various challenging tasks. Yet conventional swarm control approaches are inadequate for coping with swarm scalability, computational requirements, and real-time performance. In this paper, we demonstrate the capability of emerging multi-agent reinforcement learning (MARL) approaches to successfully and efficiently make sequential decisions during UAV swarm collaborative tasks. We propose a scalable, real-time, MARL approach for UAV collaborative navigation where members of the swarm have to arrive at target locations at the same time. Centralized training and decentralized execution (CTDE) are used to achieve this, where a combination of negative and positive reinforcement is employed in the reward function. Curriculum learning is used to facilitate the sought performance, especially due to the high complexity of the problem which requires extensive exploration. A UAV model that highly resembles the respective physical platform is used for training the proposed framework to make training and testing realistic. The scalability of the platform to various swarm sizes, speeds, goal positions, environment dimensions, and UAV masses has been showcased in (1) a load drop-off scenario, and (2) UAV swarm formation without requiring any re-training or fine-tuning of the agents. The obtained simulation results have proven the effectiveness and generalizability of our proposed MARL framework for cooperative UAV navigation.

Förderung

  • Khalifa University

Zitieren

APA

Azzam, R., Boiko, I., & Zweiri, Y. (2023). Swarm Cooperative Navigation Using Centralized Training and Decentralized Execution. Drones, 7(3), 193. https://doi.org/10.3390/drones7030193

Vancouver

Azzam R, Boiko I, Zweiri Y. Swarm Cooperative Navigation Using Centralized Training and Decentralized Execution. Drones. 2023;7(3):193. doi:10.3390/drones7030193

BibTeX
@article{Azzam2023,
  author = {Azzam, Rana and Boiko, Igor and Zweiri, Yahya},
  title = {Swarm Cooperative Navigation Using Centralized Training and Decentralized Execution},
  journal = {Drones},
  year = {2023},
  volume = {7},
  number = {3},
  pages = {193},
  doi = {10.3390/drones7030193}
}
Kostenlos starten →