EUVIMEDEUVIMED entdecken
Crossref

Top-Down Cross-Modal Guidance for Robust RGB-T Tracking

Liang Chen, Bineng Zhong, Qihua Liang, Yaozong Zheng, Zhiyi Mo, Shuxiang Song

IEEE Transactions on Circuits and Systems for Video Technology · 2024-12 · 34 (12) · 12388-12398

DOI: 10.1109/tcsvt.2024.3435722 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-12. Verfasst von Liang Chen und 5 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 62 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Project of Guangxi Science and Technology, Guangxi “Young Bagui Scholar” Teams for Innovation and Research Project.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Most RGB-T trackers heavily rely on bottom-up attention and thus overlook top-down cross-modal guidance for learning target features. Consequently, the discriminative power of the learnt target features is weak. To address this issue, we propose a novel RGB-T tracker (called TGTrack) that designs a Top-down Cross-modal Guidance mechanism to learn target features in two stages. In the first stage, our TGTrack effectively generates top-down cross-modal guidance signals with multi-modal encoders-decoders and prior vectors. In the second stage, these signals are transmitted and integrated to improve the discriminative power of our target features by the attention layers of the cross-modal encoders. Moreover, we introduce an Attention-Driven Spatio-Temporal Updater for updating discriminative target features. Through cross-frame attention guidance, it can effectively eliminates irrelevant features within the search region. As a result, our TGTrack can effectively avoid the complex multi-modal fusion modules and thus achieve robust RGB-T tracking. Extensive experiments on three popular RGB-T tracking benchmarks (i.e., LasHeR, RGBT234, and RGBT210) demonstrate that our TGTrack achieves new state-of-the-art performances.

Förderung

  • National Natural Science Foundation of China
  • Project of Guangxi Science and Technology
  • Guangxi “Young Bagui Scholar” Teams for Innovation and Research Project
  • Guangxi “Bagui Scholar” Teams for Innovation and Research Project
  • Guangxi Collaborative Innovation Center of Multi-Source Information Integration and Intelligent Processing
  • Guangxi Talent Highland Project of Big Data Intelligence and Application
  • Research Project of Guangxi Normal University
  • Innovation Project of Guangxi Graduate Education

Zitieren

APA

Chen, L., Zhong, B., Liang, Q., Zheng, Y., Mo, Z., & Song, S. (2024). Top-Down Cross-Modal Guidance for Robust RGB-T Tracking. IEEE Transactions on Circuits and Systems for Video Technology, 34(12), 12388-12398. https://doi.org/10.1109/tcsvt.2024.3435722

Vancouver

Chen L, Zhong B, Liang Q, Zheng Y, Mo Z, Song S. Top-Down Cross-Modal Guidance for Robust RGB-T Tracking. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(12):12388-12398. doi:10.1109/tcsvt.2024.3435722

BibTeX
@article{Chen2024,
  author = {Chen, Liang and Zhong, Bineng and Liang, Qihua and Zheng, Yaozong and Mo, Zhiyi and Song, Shuxiang},
  title = {Top-Down Cross-Modal Guidance for Robust RGB-T Tracking},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2024},
  volume = {34},
  number = {12},
  pages = {12388--12398},
  doi = {10.1109/tcsvt.2024.3435722}
}
Kostenlos starten →