EUVIMEDEUVIMED entdecken
Crossref

Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understanding

Guo Chen, Yifei Huang, Jilan Xu, Baoqi Pei, Jiahao Wang, Zhe Chen, Zhiqi Li, Tong Lu, Limin Wang

International Journal of Computer Vision · 2026-01 · 134 (1)

DOI: 10.1007/s11263-025-02597-y ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Computer Vision, online erschienen am 26.12.2025. Verfasst von Guo Chen und 8 weiteren Autor:innen. Die Arbeit wurde bisher 63-mal zitiert (Crossref) und nennt 131 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

State space models (SSMs) have demonstrated remarkable capabilities in natural language processing. Yet, their applicability to video understanding remains underexplored. We present the Video Mamba Suite, a suite of Mamba-based model families together with a unified evaluation protocol covering four roles in video understanding: temporal modeling, cross-modal interaction, temporal adapters, and spatiotemporal modeling. To address limitations of existing bidirectional scanning mechanisms, we propose the Decomposed Bidirectional Mamba (DBM) block, which enhances temporal modeling through parameter-sharing bidirectional pathways with separated input projections. Through extensive experiments spanning 14 SSM-based models across 12 video understanding tasks—including temporal localization, action segmentation, video captioning, and multimodal retrieval—we demonstrate that Mamba consistently achieves competitive or superior performance compared to Transformer baselines while maintaining linear computational complexity. Our findings establish SSMs as viable, versatile alternatives to Transformers for video understanding, offering significant efficiency advantages for long-sequence processing.

Zitieren

APA

Chen, G., Huang, Y., Xu, J., Pei, B., Wang, J., Chen, Z., Li, Z., Lu, T., & Wang, L. (2026). Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understanding. International Journal of Computer Vision, 134(1). https://doi.org/10.1007/s11263-025-02597-y

Vancouver

Chen G, Huang Y, Xu J, Pei B, Wang J, Chen Z, et al. Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understanding. International Journal of Computer Vision. 2026;134(1). doi:10.1007/s11263-025-02597-y

BibTeX
@article{Chen2026,
  author = {Chen, Guo and Huang, Yifei and Xu, Jilan and Pei, Baoqi and Wang, Jiahao and Chen, Zhe and Li, Zhiqi and Lu, Tong and Wang, Limin},
  title = {Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understanding},
  journal = {International Journal of Computer Vision},
  year = {2026},
  volume = {134},
  number = {1},
  doi = {10.1007/s11263-025-02597-y}
}
Kostenlos starten →