EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Application of Deep Reinforcement Learning to UAV Swarming for Ground Surveillance

Raúl Arranz iD, David Carramiñana iD, Gonzalo de Miguel iD, Juan A Besada iD, Ana M Bernardos iD

Sensors · 27.10.2023 · 23 (21) · 8766

DOI: 10.3390/s23218766 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 27.10.2023. Verfasst von Raúl Arranz und 4 weiteren Autor:innen. Beteiligte Einrichtung: Information Processing and Telecommunications Center, Universidad Politécnica de Madrid, ETSI Telecomunicación, Av. Complutense 30, 28040 Madrid, Spa…. Die Arbeit wurde bisher 46-mal zitiert (Crossref) und nennt 78 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: MCIN/AEI/10.13039/501100011033, European Union's Horizon 2020 Research and Innovation Programme, European Union’s Horizon 2020 Research and Innovation Programme.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper summarizes in depth the state of the art of aerial swarms, covering both classical and new reinforcement-learning-based approaches for their management. Then, it proposes a hybrid AI system, integrating deep reinforcement learning in a multi-agent centralized swarm architecture. The proposed system is tailored to perform surveillance of a specific area, searching and tracking ground targets, for security and law enforcement applications. The swarm is governed by a central swarm controller responsible for distributing different search and tracking tasks among the cooperating UAVs. Each UAV agent is then controlled by a collection of cooperative sub-agents, whose behaviors have been trained using different deep reinforcement learning models, tailored for the different task types proposed by the swarm controller. More specifically, proximal policy optimization (PPO) algorithms were used to train the agents’ behavior. In addition, several metrics to assess the performance of the swarm in this application were defined. The results obtained through simulation show that our system searches the operation area effectively, acquires the targets in a reasonable time, and is capable of tracking them continuously and consistently.

Schlagwörter

Stichwörter der Autor:innen

artificial intelligencecentralizeddronesobstacle avoidancesearchswarmtracking

Autor:innen und Institutionen

  • Information Processing and Telecommunications Center, Universidad Politécnica de Madrid, ETSI Telecomunicación, Av. Complutense 30, 28040 Madrid, Spain.

ORCID-Profile: Raúl Arranz, David Carramiñana, Gonzalo de Miguel, Juan A Besada, Ana M Bernardos

Förderung

  • MCIN/AEI/10.13039/501100011033
  • European Union's Horizon 2020 Research and Innovation Programme
  • European Union’s Horizon 2020 Research and Innovation Programme

Zitieren

APA

Arranz, R., Carramiñana, D., Miguel, G., Besada, J. A., & Bernardos, A. M. (2023). Application of Deep Reinforcement Learning to UAV Swarming for Ground Surveillance. Sensors, 23(21), 8766. https://doi.org/10.3390/s23218766

Vancouver

Arranz R, Carramiñana D, Miguel G, Besada JA, Bernardos AM. Application of Deep Reinforcement Learning to UAV Swarming for Ground Surveillance. Sensors. 2023;23(21):8766. doi:10.3390/s23218766

BibTeX
@article{Arranz2023,
  author = {Arranz, Raúl and Carramiñana, David and Miguel, Gonzalo de and Besada, Juan A and Bernardos, Ana M},
  title = {Application of Deep Reinforcement Learning to UAV Swarming for Ground Surveillance},
  journal = {Sensors},
  year = {2023},
  volume = {23},
  number = {21},
  pages = {8766},
  doi = {10.3390/s23218766}
}
Kostenlos starten →