EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Deep Reinforcement Learning for UAV Target Search and Continuous Tracking in Complex Environments with Gaussian Process Regression and Prior Policy Embedding

Zhihui Feng, Xitai Na, Shiji Hai, Qingbin Sun, Jinshuo Shi

Electronics · 27.03.2025 · 14 (7) · 1330

DOI: 10.3390/electronics14071330 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 27.03.2025. Verfasst von Zhihui Feng und 4 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In recent years, unmanned aerial vehicles (UAVs) have shown substantial application value in continuous target tracking tasks in complex environments. Due to the target’s movement behavior and the complexities of the surrounding environment, the UAV is prone to losing track of the target. To tackle this issue, this paper presents a reinforcement learning (RL) approach that combines UAV target search and tracking. During the target search phase, spatial information entropy is employed to guide the UAV in avoiding redundant searches, thus enhancing information acquisition efficiency. In the event of target loss, Gaussian process regression (GPR) is employed to predict the target trajectory, thereby reducing the time needed for target re-localization. In addition, to address sample efficiency limitations in conventional RL, a Kolmogorov–Arnold networks-based deep deterministic policy gradient (KbDDPG) algorithm with prior policy embedding is proposed for controller training.Simulation results demonstrate that the proposed method outperforms traditional methods in target search and tracking tasks within complex environments. It improves the UAV’s ability to re-locate the target after loss. The proposed KbDDPG efficiently leverages prior policy, leading to accelerated convergence and enhanced performance.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Feng, Z., Na, X., Hai, S., Sun, Q., & Shi, J. (2025). Deep Reinforcement Learning for UAV Target Search and Continuous Tracking in Complex Environments with Gaussian Process Regression and Prior Policy Embedding. Electronics, 14(7), 1330. https://doi.org/10.3390/electronics14071330

Vancouver

Feng Z, Na X, Hai S, Sun Q, Shi J. Deep Reinforcement Learning for UAV Target Search and Continuous Tracking in Complex Environments with Gaussian Process Regression and Prior Policy Embedding. Electronics. 2025;14(7):1330. doi:10.3390/electronics14071330

BibTeX
@article{Feng2025,
  author = {Feng, Zhihui and Na, Xitai and Hai, Shiji and Sun, Qingbin and Shi, Jinshuo},
  title = {Deep Reinforcement Learning for UAV Target Search and Continuous Tracking in Complex Environments with Gaussian Process Regression and Prior Policy Embedding},
  journal = {Electronics},
  year = {2025},
  volume = {14},
  number = {7},
  pages = {1330},
  doi = {10.3390/electronics14071330}
}
Kostenlos starten →