EUVIMEDEUVIMED entdecken
Crossref

Multi-Step Temporal Modeling for UAV Tracking

Xiaoying Yuan, Tingfa Xu, Xincong Liu, Ying Wang, Haolin Qin, Yuqiang Fang, Jianan Li

IEEE Transactions on Circuits and Systems for Video Technology · 2024-08 · 34 (8) · 7216-7230

DOI: 10.1109/tcsvt.2024.3375366 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-08. Verfasst von Xiaoying Yuan und 6 weiteren Autor:innen. Die Arbeit wurde bisher 33-mal zitiert (Crossref) und nennt 71 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Young Elite Scientist Sponsorship Program of China Association for Science and Technology, Young Elite Scientist Sponsorship Program of Beijing Association for Science and Technology.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In the realm of unmanned aerial vehicle (UAV) tracking, Siamese-based approaches have gained traction due to their optimal balance between efficiency and precision. However, UAV scenarios often present challenges such as insufficient sampling resolution, fast motion and small objects with limited feature information. As a result, temporal context in UAV tracking tasks plays a pivotal role in target location, overshadowing the target’s precise features. In this paper, we introduce MT-Track, a streamlined and efficient multi-step temporal modeling framework designed to harness the temporal context from historical frames for enhanced UAV tracking. This temporal integration occurs in two steps: correlation map generation and correlation map refinement. Specifically, we unveil a unique temporal correlation module that dynamically assesses the interplay between the template and search region features. This module leverages temporal information to refresh the template feature, yielding a more precise correlation map. Subsequently, we propose a mutual transformer module to refine the correlation maps of historical and current frames by modeling the temporal knowledge in the tracking sequence. This method significantly trims computational demands compared to the raw transformer. The compact yet potent nature of our tracking framework ensures commendable tracking outcomes, particularly in extended tracking scenarios. Comprehensive tests across four renowned UAV benchmarks substantiate the superior efficacy of our approach, delivering real-time performance at 84.7 FPS on a single GPU. Real-world test on the NVIDIA AGX hardware platform achieves a speed exceeding 30 FPS, validating the practicality of our method.

Förderung

  • National Natural Science Foundation of China
  • Young Elite Scientist Sponsorship Program of China Association for Science and Technology
  • Young Elite Scientist Sponsorship Program of Beijing Association for Science and Technology

Zitieren

APA

Yuan, X., Xu, T., Liu, X., Wang, Y., Qin, H., Fang, Y., & Li, J. (2024). Multi-Step Temporal Modeling for UAV Tracking. IEEE Transactions on Circuits and Systems for Video Technology, 34(8), 7216-7230. https://doi.org/10.1109/tcsvt.2024.3375366

Vancouver

Yuan X, Xu T, Liu X, Wang Y, Qin H, Fang Y, et al. Multi-Step Temporal Modeling for UAV Tracking. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(8):7216-7230. doi:10.1109/tcsvt.2024.3375366

BibTeX
@article{Yuan2024,
  author = {Yuan, Xiaoying and Xu, Tingfa and Liu, Xincong and Wang, Ying and Qin, Haolin and Fang, Yuqiang and Li, Jianan},
  title = {Multi-Step Temporal Modeling for UAV Tracking},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2024},
  volume = {34},
  number = {8},
  pages = {7216--7230},
  doi = {10.1109/tcsvt.2024.3375366}
}
Kostenlos starten →