A Hierarchical Reinforcement Learning Framework for UAV Path Planning in Tactical Environments
Turkish Journal of Science and Technology · 29.03.2023 · 18 (1) · 243-259
DOI: 10.55525/tjst.1219845 ↗Kurz gefasst
Fachartikel in der Zeitschrift Turkish Journal of Science and Technology, online erschienen am 29.03.2023. Verfasst von Mahmut Nedim ALPDEMİR. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 51 Literaturangaben.
Abstract (Originalsprache)
Tactical UAV path planning under radar threat using reinforcement learning involves particular challenges ranging from modeling related difficulties to sparse feedback problem. Learning goal-directed behavior with sparse feedback from complex environments is a fundamental challenge for reinforcement learning algorithms. In this paper we extend our previous work in this area to provide a solution to the problem setting stated above, using Hierarchical Reinforcement Learning (HRL) in a novel way that involves a meta controller for higher level goal assignment and a controller that determines the lower-level actions of the agent. Our meta controller is based on a regression model trained using a state transition scheme that defines the evolution of goal designation, whereas our lower-level controller is based on a Deep Q Network (DQN) and is trained via reinforcement learning iterations. This two-layer framework ensures that an optimal plan for a complex path, organized as multiple goals, is achieved gradually, through piecewise assignment of sub-goals, and thus as a result of a staged, efficient and rigorous procedure.
Zitieren
APA
ALPDEMİR, M. N. (2023). A Hierarchical Reinforcement Learning Framework for UAV Path Planning in Tactical Environments. Turkish Journal of Science and Technology, 18(1), 243-259. https://doi.org/10.55525/tjst.1219845
Vancouver
ALPDEMİR MN. A Hierarchical Reinforcement Learning Framework for UAV Path Planning in Tactical Environments. Turkish Journal of Science and Technology. 2023;18(1):243-259. doi:10.55525/tjst.1219845
BibTeX
@article{ALPDEMR2023,
author = {ALPDEMİR, Mahmut Nedim},
title = {A Hierarchical Reinforcement Learning Framework for UAV Path Planning in Tactical Environments},
journal = {Turkish Journal of Science and Technology},
year = {2023},
volume = {18},
number = {1},
pages = {243--259},
doi = {10.55525/tjst.1219845}
}
EUVIMED