EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Application of Deep Reinforcement Learning to Defense and Intrusion Strategies Using Unmanned Aerial Vehicles in a Versus Game

Chieh-Li Chen, Yu-Wen Huang, Ting-Ju Shen

Drones · 31.07.2024 · 8 (8) · 365

DOI: 10.3390/drones8080365 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Drones, online erschienen am 31.07.2024. Verfasst von Chieh-Li Chen und 2 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 22 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: The Armaments Bureau, MND.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Drones are used in complex scenes in different scenarios. Efficient and effective algorithms are required for drones to track targets of interest and protect allied targets in a versus game. This study used physical models of quadcopters and scene engines to investigate the resulting performance of attacker drones and defensive drones based on deep reinforcement learning. The deep reinforcement learning network soft actor-critic was applied in association with the proposed reward and penalty functions according to the design scenario. AirSim UAV physical modeling and mission scenarios based on Unreal Engine were used to simultaneously train attacking and defending gaming skills for both drones, such that the required combat strategies and flight skills could be improved through a series of competition episodes. After 500 episodes of practice experience, both drones could accelerate, detour, and evade to achieve reasonably good performance with a roughly tie situation. Validation scenarios also demonstrated that the attacker–defender winning ratio also improved from 1:2 to 1.2:1, which is reasonable for drones with equal flight capabilities. Although this showed that the attacker may have an advantage in inexperienced scenarios, it revealed that the strategies generated by deep reinforcement learning networks are robust and feasible.

Förderung

  • The Armaments Bureau, MND

Zitieren

APA

Chen, C., Huang, Y., & Shen, T. (2024). Application of Deep Reinforcement Learning to Defense and Intrusion Strategies Using Unmanned Aerial Vehicles in a Versus Game. Drones, 8(8), 365. https://doi.org/10.3390/drones8080365

Vancouver

Chen C, Huang Y, Shen T. Application of Deep Reinforcement Learning to Defense and Intrusion Strategies Using Unmanned Aerial Vehicles in a Versus Game. Drones. 2024;8(8):365. doi:10.3390/drones8080365

BibTeX
@article{Chen2024,
  author = {Chen, Chieh-Li and Huang, Yu-Wen and Shen, Ting-Ju},
  title = {Application of Deep Reinforcement Learning to Defense and Intrusion Strategies Using Unmanned Aerial Vehicles in a Versus Game},
  journal = {Drones},
  year = {2024},
  volume = {8},
  number = {8},
  pages = {365},
  doi = {10.3390/drones8080365}
}
Kostenlos starten →