Top-Down Cross-Modal Guidance for Robust RGB-T Tracking
IEEE Transactions on Circuits and Systems for Video Technology · 2024-12 · 34 (12) · 12388-12398
DOI: 10.1109/tcsvt.2024.3435722 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-12. Verfasst von Liang Chen und 5 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 62 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Project of Guangxi Science and Technology, Guangxi “Young Bagui Scholar” Teams for Innovation and Research Project.
Abstract (Originalsprache)
Most RGB-T trackers heavily rely on bottom-up attention and thus overlook top-down cross-modal guidance for learning target features. Consequently, the discriminative power of the learnt target features is weak. To address this issue, we propose a novel RGB-T tracker (called TGTrack) that designs a Top-down Cross-modal Guidance mechanism to learn target features in two stages. In the first stage, our TGTrack effectively generates top-down cross-modal guidance signals with multi-modal encoders-decoders and prior vectors. In the second stage, these signals are transmitted and integrated to improve the discriminative power of our target features by the attention layers of the cross-modal encoders. Moreover, we introduce an Attention-Driven Spatio-Temporal Updater for updating discriminative target features. Through cross-frame attention guidance, it can effectively eliminates irrelevant features within the search region. As a result, our TGTrack can effectively avoid the complex multi-modal fusion modules and thus achieve robust RGB-T tracking. Extensive experiments on three popular RGB-T tracking benchmarks (i.e., LasHeR, RGBT234, and RGBT210) demonstrate that our TGTrack achieves new state-of-the-art performances.
Förderung
- National Natural Science Foundation of China
- Project of Guangxi Science and Technology
- Guangxi “Young Bagui Scholar” Teams for Innovation and Research Project
- Guangxi “Bagui Scholar” Teams for Innovation and Research Project
- Guangxi Collaborative Innovation Center of Multi-Source Information Integration and Intelligent Processing
- Guangxi Talent Highland Project of Big Data Intelligence and Application
- Research Project of Guangxi Normal University
- Innovation Project of Guangxi Graduate Education
Zitieren
APA
Chen, L., Zhong, B., Liang, Q., Zheng, Y., Mo, Z., & Song, S. (2024). Top-Down Cross-Modal Guidance for Robust RGB-T Tracking. IEEE Transactions on Circuits and Systems for Video Technology, 34(12), 12388-12398. https://doi.org/10.1109/tcsvt.2024.3435722
Vancouver
Chen L, Zhong B, Liang Q, Zheng Y, Mo Z, Song S. Top-Down Cross-Modal Guidance for Robust RGB-T Tracking. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(12):12388-12398. doi:10.1109/tcsvt.2024.3435722
BibTeX
@article{Chen2024,
author = {Chen, Liang and Zhong, Bineng and Liang, Qihua and Zheng, Yaozong and Mo, Zhiyi and Song, Shuxiang},
title = {Top-Down Cross-Modal Guidance for Robust RGB-T Tracking},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2024},
volume = {34},
number = {12},
pages = {12388--12398},
doi = {10.1109/tcsvt.2024.3435722}
}
EUVIMED