SiamHSFT: A Siamese Network-Based Tracker with Hierarchical Sparse Fusion and Transformer for UAV Tracking
Sensors · 24.10.2023 · 23 (21) · 8666
DOI: 10.3390/s23218666 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 24.10.2023. Verfasst von Xiuhua Hu und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Computer Science and Engineering, Xi'an Technological University, Xi'an 710021, China. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 66 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: the Natural Science Basic Research Project of Shaanxi Provincial Department of Science and Technology, Natural Science Basic Research Project of the Shaanxi Provincial Department of Science and Technology.
Abstract (Originalsprache)
Due to high maneuverability as well as hardware limitations of Unmanned Aerial Vehicle (UAV) platforms, tracking targets in UAV views often encounter challenges such as low resolution, fast motion, and background interference, which make it difficult to strike a compatibility between performance and efficiency. Based on the Siamese network framework, this paper proposes a novel UAV tracking algorithm, SiamHSFT, aiming to achieve a balance between tracking robustness and real-time computation. Firstly, by combining CBAM attention and downward information interaction in the feature enhancement module, the provided method merges high-level and low-level feature maps to prevent the loss of information when dealing with small targets. Secondly, it focuses on both long and short spatial intervals within the affinity in the interlaced sparse attention module, thereby enhancing the utilization of global context and prioritizing crucial information in feature extraction. Lastly, the Transformer’s encoder is optimized with a modulation enhancement layer, which integrates triplet attention to enhance inter-layer dependencies and improve target discrimination. Experimental results demonstrate SiamHSFT’s excellent performance across diverse datasets, including UAV123, UAV20L, UAV123@10fps, and DTB70. Notably, it performs better in fast motion and dynamic blurring scenarios. Meanwhile, it maintains an average tracking speed of 126.7 fps across all datasets, meeting real-time tracking requirements.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Computer Science and Engineering, Xi'an Technological University, Xi'an 710021, China.
- State and Provincial Joint Engineering Laboratory of Advanced Network, Monitoring and Control, Xi'an 710021, China.
Förderung
- the Natural Science Basic Research Project of Shaanxi Provincial Department of Science and Technology
- Natural Science Basic Research Project of the Shaanxi Provincial Department of Science and Technology
Zitieren
APA
Hu, X., Zhao, J., Hui, Y., Li, S., & You, S. (2023). SiamHSFT: A Siamese Network-Based Tracker with Hierarchical Sparse Fusion and Transformer for UAV Tracking. Sensors, 23(21), 8666. https://doi.org/10.3390/s23218666
Vancouver
Hu X, Zhao J, Hui Y, Li S, You S. SiamHSFT: A Siamese Network-Based Tracker with Hierarchical Sparse Fusion and Transformer for UAV Tracking. Sensors. 2023;23(21):8666. doi:10.3390/s23218666
BibTeX
@article{Hu2023,
author = {Hu, Xiuhua and Zhao, Jing and Hui, Yan and Li, Shuang and You, Shijie},
title = {SiamHSFT: A Siamese Network-Based Tracker with Hierarchical Sparse Fusion and Transformer for UAV Tracking},
journal = {Sensors},
year = {2023},
volume = {23},
number = {21},
pages = {8666},
doi = {10.3390/s23218666}
}
EUVIMED