EUVIMEDEUVIMED entdecken
Crossref

MUSE: Mamba Is Efficient Multi-scale Learner for Text-video Retrieval

Haoran Tang, Meng Cao, Jinfa Huang, Ruyang Liu, Peng Jin, Ge Li, Xiaodan Liang

Proceedings of the AAAI Conference on Artificial Intelligence · 11.04.2025 · 39 (7) · 7238-7246

DOI: 10.1609/aaai.v39i7.32778 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 11.04.2025. Verfasst von Haoran Tang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Text-Video Retrieval (TVR) aims to align and associate relevant video content with corresponding natural language queries. Most existing TVR methods are based on large-scale pre-trained vision-language models (e.g., CLIP). However, due to CLIP's inherent plain structure, few TVR methods explore the multi-scale representations which offer richer contextual information for a more thorough understanding. To this end, we propose MUSE, a multi-scale mamba with linear computational complexity for efficient cross-resolution modeling. Specifically, the multi-scale representations are generated by applying a feature pyramid on the last single-scale feature map. Then, we employ the Mamba structure as an efficient multi-scale learner to jointly learn scale-wise representations. Furthermore, we conduct comprehensive studies to investigate different model structures and designs. Extensive results on three popular benchmarks have validated the superiority of MUSE.

Zitieren

APA

Tang, H., Cao, M., Huang, J., Liu, R., Jin, P., Li, G., & Liang, X. (2025). MUSE: Mamba Is Efficient Multi-scale Learner for Text-video Retrieval. Proceedings of the AAAI Conference on Artificial Intelligence, 39(7), 7238-7246. https://doi.org/10.1609/aaai.v39i7.32778

Vancouver

Tang H, Cao M, Huang J, Liu R, Jin P, Li G, et al. MUSE: Mamba Is Efficient Multi-scale Learner for Text-video Retrieval. Proceedings of the AAAI Conference on Artificial Intelligence. 2025;39(7):7238-7246. doi:10.1609/aaai.v39i7.32778

BibTeX
@article{Tang2025,
  author = {Tang, Haoran and Cao, Meng and Huang, Jinfa and Liu, Ruyang and Jin, Peng and Li, Ge and Liang, Xiaodan},
  title = {MUSE: Mamba Is Efficient Multi-scale Learner for Text-video Retrieval},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2025},
  volume = {39},
  number = {7},
  pages = {7238--7246},
  doi = {10.1609/aaai.v39i7.32778}
}
Kostenlos starten →