EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

A Multimodal Video Anomaly Detection Method Based on Vision-Language Alignment

Yueai Zhao, Yan Zhang, Shihao Wang, Lipei Kong

Journal of Computing and Electronic Information Management · 26.04.2026 · 21 (1) · 59-66

DOI: 10.54097/d1qryr89 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Computing and Electronic Information Management, online erschienen am 26.04.2026. Verfasst von Yueai Zhao und 3 weiteren Autor:innen. Die Arbeit nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Existing weakly supervised anomaly detection methods suffer from insufficient semantic alignment of features and a lack of fine-grained localisation capabilities. Furthermore, purely visual models have limitations in understanding semantic information, making it difficult to effectively integrate visual features with semantic information, which results in poor discrimination of multi-class anomalies. To address these issues, this paper proposes a vision-language aligned video anomaly detection model. By introducing a vision-language alignment branch and utilising a pre-trained CLIP model to achieve fine-grained semantic alignment between video features and category text prompts, this model overcomes the limitations of purely visual models in understanding semantic information.It designs an adaptive gated fusion mechanism to dynamically fuse the global anomaly scores from the original visual branch with the semantically guided scores from the alignment branch, combining the complementary strengths of visual pattern recognition and semantic understanding to enhance the model’s ability to distinguish between multiple anomaly categories.And it constructs a multi-task loss function to jointly optimise temporal localisation and fine-grained classification tasks, making full use of video-level weak supervision signals and cross-modal alignment information. Experimental results on the UCF-Crime and XD-Violence datasets demonstrate that this method effectively improves fine-grained anomaly localisation and classification performance, exhibiting significant advantages.

Zitieren

APA

Zhao, Y., Zhang, Y., Wang, S., & Kong, L. (2026). A Multimodal Video Anomaly Detection Method Based on Vision-Language Alignment. Journal of Computing and Electronic Information Management, 21(1), 59-66. https://doi.org/10.54097/d1qryr89

Vancouver

Zhao Y, Zhang Y, Wang S, Kong L. A Multimodal Video Anomaly Detection Method Based on Vision-Language Alignment. Journal of Computing and Electronic Information Management. 2026;21(1):59-66. doi:10.54097/d1qryr89

BibTeX
@article{Zhao2026,
  author = {Zhao, Yueai and Zhang, Yan and Wang, Shihao and Kong, Lipei},
  title = {A Multimodal Video Anomaly Detection Method Based on Vision-Language Alignment},
  journal = {Journal of Computing and Electronic Information Management},
  year = {2026},
  volume = {21},
  number = {1},
  pages = {59--66},
  doi = {10.54097/d1qryr89}
}
Kostenlos starten →