Adaptive Expert Decision for RGB-T Tracking
IEEE Transactions on Circuits and Systems for Video Technology · 2025-10 · 35 (10) · 10330-10338
DOI: 10.1109/tcsvt.2025.3563223 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2025-10. Verfasst von Zhiruo Zhu und 5 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 53 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Project of Guangxi Science and Technology, Guangxi “Young Bagui Scholar” Teams for Innovation and Research Project through the Research Project of Guangxi Normal University.
Abstract (Originalsprache)
The features provided by RGB and Thermal Infrared (TIR) images have their own characteristics. Therefore, how to adaptively fuse multi-modal features according to different tracking scenarios is crucial for RGB-T tracking. However, current mainstream RGB-T tracking algorithms often use fixed fusion operations for modal interaction in different scenarios. Consequently, their tracking permanence is deteriorated due to they are unable to dynamically adjust the fused multi-modal features based on the current scenes. To address this issue, we propose a novel RGB-T tracking algorithm called AETrack, which can dynamically extract effective modal features in different scenarios for adaptive fusion. Firstly, we design an adaptive expert decision mechanism that employs multiple experts to process the input features. Each expert focuses on and learns different relevant features. Based on this mechanism, we then propose a feature-guided method that leverages the correlations between modalities to provide cross-modal information. This guidance enables the adaptive expert mechanism to adaptively select the most suitable expert to output effective features based on different scenarios, ensuring that our proposed AETrack prioritizes effective features and thus alleviates interference from irrelevant information. Finally, we design a Progressive Cross-modal Fusion operation to achieve multi-level adaptive fusion of effective features across different modalities. Benefiting from this adaptive fusion process, we can effectively achieve multi-modal interaction in different scenarios to guide robust tracking. Extensive experiments on three popular benchmarks (i.e., LasHeR, RGBT210, RGBT234) show that our proposed AETrack can significantly improve tracking performance.
Förderung
- National Natural Science Foundation of China
- Project of Guangxi Science and Technology
- Guangxi “Young Bagui Scholar” Teams for Innovation and Research Project through the Research Project of Guangxi Normal University
- Innovation Project of Guangxi Graduate Education
- Guangxi Colleges and Universities Key Laboratory of Intelligent Software
Zitieren
APA
Zhu, Z., Zhong, B., Liang, Q., Yang, H., Zheng, Y., & Li, N. (2025). Adaptive Expert Decision for RGB-T Tracking. IEEE Transactions on Circuits and Systems for Video Technology, 35(10), 10330-10338. https://doi.org/10.1109/tcsvt.2025.3563223
Vancouver
Zhu Z, Zhong B, Liang Q, Yang H, Zheng Y, Li N. Adaptive Expert Decision for RGB-T Tracking. IEEE Transactions on Circuits and Systems for Video Technology. 2025;35(10):10330-10338. doi:10.1109/tcsvt.2025.3563223
BibTeX
@article{Zhu2025,
author = {Zhu, Zhiruo and Zhong, Bineng and Liang, Qihua and Yang, Hongtao and Zheng, Yaozong and Li, Ning},
title = {Adaptive Expert Decision for RGB-T Tracking},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2025},
volume = {35},
number = {10},
pages = {10330--10338},
doi = {10.1109/tcsvt.2025.3563223}
}
EUVIMED