EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Vision-Based End-to-End Reinforcement Learning Framework for Drone Target Tracking

Xun Zhao, Xinjian Huang, Jianheng Cheng, Zhendong Xia, Zhiheng Tu

Drones · 30.10.2024 · 8 (11) · 628

DOI: 10.3390/drones8110628 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Drones, online erschienen am 30.10.2024. Verfasst von Xun Zhao und 4 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Drone target tracking, which involves instructing drone movement to follow a moving target, encounters several challenges: (1) traditional methods need accurate state estimation of both the drone and target; (2) conventional Proportional–Derivative (PD) controllers require tedious parameter tuning and struggle with nonlinear properties; and (3) reinforcement learning methods, though promising, rely on the drone’s self-state estimation, adding complexity and computational load and reducing reliability. To address these challenges, this study proposes an innovative model-free end-to-end reinforcement learning framework, the VTD3 (Vision-Based Twin Delayed Deep Deterministic Policy Gradient), for drone target tracking tasks. This framework focuses on controlling the drone to follow a moving target while maintaining a specific distance. VTD3 is a pure vision-based tracking algorithm which integrates the YOLOv8 detector, the BoT-SORT tracking algorithm, and the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm. It diminishes reliance on GPS and other sensors while simultaneously enhancing the tracking capability for complex target motion trajectories. In a simulated environment, we assess the tracking performance of VTD3 across four complex target motion trajectories (triangular, square, sawtooth, and square wave, including scenarios with occlusions). The experimental results indicate that our proposed VTD3 reinforcement learning algorithm substantially outperforms conventional PD controllers in drone target tracking applications. Across various target trajectories, the VTD3 algorithm demonstrates a significant reduction in average tracking errors along the X-axis and Y-axis of up to 34.35% and 45.36%, respectively. Additionally, it achieves a notable improvement of up to 66.10% in altitude control precision. In terms of motion smoothness, the VTD3 algorithm markedly enhances performance metrics, with improvements of up to 37.70% in jitter and 60.64% in Jerk RMS. Empirical results verify the superiority and feasibility of our proposed VTD3 framework for drone target tracking.

Zitieren

APA

Zhao, X., Huang, X., Cheng, J., Xia, Z., & Tu, Z. (2024). A Vision-Based End-to-End Reinforcement Learning Framework for Drone Target Tracking. Drones, 8(11), 628. https://doi.org/10.3390/drones8110628

Vancouver

Zhao X, Huang X, Cheng J, Xia Z, Tu Z. A Vision-Based End-to-End Reinforcement Learning Framework for Drone Target Tracking. Drones. 2024;8(11):628. doi:10.3390/drones8110628

BibTeX
@article{Zhao2024,
  author = {Zhao, Xun and Huang, Xinjian and Cheng, Jianheng and Xia, Zhendong and Tu, Zhiheng},
  title = {A Vision-Based End-to-End Reinforcement Learning Framework for Drone Target Tracking},
  journal = {Drones},
  year = {2024},
  volume = {8},
  number = {11},
  pages = {628},
  doi = {10.3390/drones8110628}
}
Kostenlos starten →