RelVid: Relational Learning with Vision-Language Models for Weakly Video Anomaly Detection
Sensors · 25.03.2025 · 25 (7) · 2037
DOI: 10.3390/s25072037 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 25.03.2025. Verfasst von Jingxin Wang und 5 weiteren Autor:innen. Beteiligte Einrichtung: Shanghai Advanced Research Institute, Chinese Academy of Sciences, Shanghai 201210, China. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Youth Innovation Promotion Association of the Chinese Academy of Sciences, Guangxi Key Research and Development Plan.
Abstract (Originalsprache)
Weakly supervised video anomaly detection aims to identify abnormal events in video sequences without requiring frame-level supervision, which is a challenging task in computer vision. Traditional methods typically rely on low-level visual features with weak supervision from a single backbone branch, which often struggles to capture the distinctive characteristics of different categories. This limitation reduces their adaptability to real-world scenarios. In real-world situations, the boundary between normal and abnormal events is often unclear and context-dependent. For example, running on a track may be considered normal, but running on a busy road could be deemed abnormal. To address these challenges, RelVid is introduced as a novel framework that improves anomaly detection by expanding the relative feature gap between classes extracted from a single backbone branch. The key innovation of RelVid lies in the integration of auxiliary tasks, which guide the model to learn more discriminative features, significantly boosting the model’s performance. These auxiliary tasks—including text-based anomaly detection and feature reconstruction learning—act as additional supervision, helping the model capture subtle differences and anomalies that are often difficult to detect in weakly supervised settings. In addition, RelVid incorporates two other components, which include class activation feature learning for improved feature discrimination and a temporal attention module for capturing sequential dependencies. This approach enhances the model’s robustness and accuracy, enabling it to better handle complex and ambiguous scenarios. Evaluations on two widely used benchmark datasets, UCF-Crime and XD-Violence, demonstrate the effectiveness of RelVid. Compared to state-of-the-art methods, RelVid achieves superior performance in both detection accuracy and robustness.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Shanghai Advanced Research Institute, Chinese Academy of Sciences, Shanghai 201210, China.
- School of Information Science and Technology, ShanghaiTech University, Shanghai 201210, China.
- School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China.
- Academy for Engineering and Technology, Fudan University, Shanghai 200433, China.
ORCID-Profile: Zhengyi Xu, Xinrong Chen
Förderung
- Youth Innovation Promotion Association of the Chinese Academy of Sciences
- Guangxi Key Research and Development Plan
Zitieren
APA
Wang, J., Li, G., Liu, J., Xu, Z., Chen, X., & Wei, J. (2025). RelVid: Relational Learning with Vision-Language Models for Weakly Video Anomaly Detection. Sensors, 25(7), 2037. https://doi.org/10.3390/s25072037
Vancouver
Wang J, Li G, Liu J, Xu Z, Chen X, Wei J. RelVid: Relational Learning with Vision-Language Models for Weakly Video Anomaly Detection. Sensors. 2025;25(7):2037. doi:10.3390/s25072037
BibTeX
@article{Wang2025,
author = {Wang, Jingxin and Li, Guohan and Liu, Jiaqi and Xu, Zhengyi and Chen, Xinrong and Wei, Jianming},
title = {RelVid: Relational Learning with Vision-Language Models for Weakly Video Anomaly Detection},
journal = {Sensors},
year = {2025},
volume = {25},
number = {7},
pages = {2037},
doi = {10.3390/s25072037}
}
EUVIMED