Historical Object-Aware Prompt Learning for Universal Hyperspectral Object Tracking
ACM Transactions on Multimedia Computing, Communications, and Applications · 31.07.2025 · 21 (7) · 1-20
DOI: 10.1145/3736581 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 18.07.2025. Verfasst von Lu Zhang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 59 Literaturangaben. Gefördert von: National Natural Science Foundation of China, “Double First-Class” Project of China University of Mining and Technology for Independent Innovation and Social Service.
Abstract (Originalsprache)
Hyperspectral Object Tracking (HOT), utilizing rich spectral information from hyperspectral video (HSV), holds significant importance for object tracking. We identify that a major obstacle in improving HOT performance lies in effectively leveraging spectral and historical information. Furthermore, due to the mismatch in band dimensions between hyperspectral and RGB images, state-of-the-art RGB-based trackers struggle to adapt to unified HOT tasks. To address this, we propose a Historical Object-Aware Prompt Learning (HOPL) method for universal hyperspectral object tracking. Initially, we transform hyperspectral image ( \( N \) bands) into multiple sets of three bands with different combinations and feed them into a backbone network to generate base features. Subsequently, we introduce a historical object-aware prompter, where historical object-aware images are input to generate prompt features that enhance the representation of object information when combined with base features. Additionally, we design a band information fusion module to integrate the multiple sets of base features. By introducing historical object-aware prompts, HOPL significantly enhances tracking performance without retraining the backbone network. Experimental results on the HOT2023 dataset (comprising HSV with 25-band, 16-band, and 15-band wavelength ranges) and HOT2022 dataset validate the superiority of HOPL over state-of-the-art methods. The source code is available at https://github.com/rayyao/HOPL .
Förderung
- National Natural Science Foundation of China
- “Double First-Class” Project of China University of Mining and Technology for Independent Innovation and Social Service
Zitieren
APA
Zhang, L., Yao, R., Zhang, Y., Zhou, Y., Hu, F., Zhao, J., & Shao, Z. (2025). Historical Object-Aware Prompt Learning for Universal Hyperspectral Object Tracking. ACM Transactions on Multimedia Computing, Communications, and Applications, 21(7), 1-20. https://doi.org/10.1145/3736581
Vancouver
Zhang L, Yao R, Zhang Y, Zhou Y, Hu F, Zhao J, et al. Historical Object-Aware Prompt Learning for Universal Hyperspectral Object Tracking. ACM Transactions on Multimedia Computing, Communications, and Applications. 2025;21(7):1-20. doi:10.1145/3736581
BibTeX
@article{Zhang2025,
author = {Zhang, Lu and Yao, Rui and Zhang, Yuhong and Zhou, Yong and Hu, Fuyuan and Zhao, Jiaqi and Shao, Zhiwen},
title = {Historical Object-Aware Prompt Learning for Universal Hyperspectral Object Tracking},
journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
year = {2025},
volume = {21},
number = {7},
pages = {1--20},
doi = {10.1145/3736581}
}
EUVIMED