MUSE: Mamba Is Efficient Multi-scale Learner for Text-video Retrieval
Proceedings of the AAAI Conference on Artificial Intelligence · 11.04.2025 · 39 (7) · 7238-7246
DOI: 10.1609/aaai.v39i7.32778 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 11.04.2025. Verfasst von Haoran Tang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref).
Abstract (Originalsprache)
Text-Video Retrieval (TVR) aims to align and associate relevant video content with corresponding natural language queries. Most existing TVR methods are based on large-scale pre-trained vision-language models (e.g., CLIP). However, due to CLIP's inherent plain structure, few TVR methods explore the multi-scale representations which offer richer contextual information for a more thorough understanding. To this end, we propose MUSE, a multi-scale mamba with linear computational complexity for efficient cross-resolution modeling. Specifically, the multi-scale representations are generated by applying a feature pyramid on the last single-scale feature map. Then, we employ the Mamba structure as an efficient multi-scale learner to jointly learn scale-wise representations. Furthermore, we conduct comprehensive studies to investigate different model structures and designs. Extensive results on three popular benchmarks have validated the superiority of MUSE.
Zitieren
APA
Tang, H., Cao, M., Huang, J., Liu, R., Jin, P., Li, G., & Liang, X. (2025). MUSE: Mamba Is Efficient Multi-scale Learner for Text-video Retrieval. Proceedings of the AAAI Conference on Artificial Intelligence, 39(7), 7238-7246. https://doi.org/10.1609/aaai.v39i7.32778
Vancouver
Tang H, Cao M, Huang J, Liu R, Jin P, Li G, et al. MUSE: Mamba Is Efficient Multi-scale Learner for Text-video Retrieval. Proceedings of the AAAI Conference on Artificial Intelligence. 2025;39(7):7238-7246. doi:10.1609/aaai.v39i7.32778
BibTeX
@article{Tang2025,
author = {Tang, Haoran and Cao, Meng and Huang, Jinfa and Liu, Ruyang and Jin, Peng and Li, Ge and Liang, Xiaodan},
title = {MUSE: Mamba Is Efficient Multi-scale Learner for Text-video Retrieval},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2025},
volume = {39},
number = {7},
pages = {7238--7246},
doi = {10.1609/aaai.v39i7.32778}
}
EUVIMED