Enabling Real-World Supervised Video Anomaly Detection: New Open-Set Benchmark and New Framework
IEEE Transactions on Multimedia · 2026 · 28 · 4317-4331
DOI: 10.1109/tmm.2026.3660108 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Multimedia, 2026. Verfasst von He Huang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Beijing Municipal Science and Technology Commission Foundation, National Natural Science Foundation of China, AI Joint Lab of Future Urban Infrastructure.
Abstract (Originalsprache)
The inherent unpredictability of abnormal events in real-world Video Anomaly Detection (VAD) presents significant challenges for model generalization. Early unsupervised methods aim to detect any anomalies as deviations from normal patterns, but they often equate rarity with abnormality, an assumption that leads to high false positives in open-world scenarios where uncommon behaviors are not necessarily abnormal. Current mainstream supervised approaches focus on memorizing discriminative features rather than learning the underlying pattern that governs normal and abnormal events. Although their performance on the seen anomalies is superior, their capability for robust open-set inference is still limited. Moreover, conventional closed-set evaluation benchmarks obscure this critical distinction by assuming identical anomaly types during training and testing. To address this limitation, this paper constructs the Real-world Supervised Open-set Benchmark (RSOB) built on a novel large-scale traffic abnormal event dataset with precise frame-level annotation, supporting evaluation across varying supervision granularities, from full to weak supervision settings. This benchmark is also the first to enable the real-world open-set evaluation constructed on the simulation of potential open-set scenarios in the application. Moreover, we further propose a human-prior-aware framework that learns domain-agnostic normality rules through a novel Human-Prior-Focused (HPF) feature space. This space is derived from a semantic-aware transformation on pre-trained feature space to effectively separate normal events while modeling generalizable human rules. Notably, the framework is architecture-agnostic and establishes the first unified solution applicable to both supervised and weakly supervised VAD paradigms. Our extensive experiments demonstrate the superiority of our framework over traditional discriminative methods across our benchmark as well as the conventional benchmark Ubnormal. The code and dataset will be publicly available.
Förderung
- Beijing Municipal Science and Technology Commission Foundation
- National Natural Science Foundation of China
- AI Joint Lab of Future Urban Infrastructure
- Fuzhou Chengtou New Infrastructure Group
- Boyun Vision Company Ltd
- PKU-NTU Joint Research Institute
- Ng Teng Fong Charitable Foundation
Zitieren
APA
Huang, H., Hu, Z., Feng, D., Chen, Z., Li, D., Liu, H., & Duan, L. (2026). Enabling Real-World Supervised Video Anomaly Detection: New Open-Set Benchmark and New Framework. IEEE Transactions on Multimedia, 28, 4317-4331. https://doi.org/10.1109/tmm.2026.3660108
Vancouver
Huang H, Hu Z, Feng D, Chen Z, Li D, Liu H, et al. Enabling Real-World Supervised Video Anomaly Detection: New Open-Set Benchmark and New Framework. IEEE Transactions on Multimedia. 2026;28:4317-4331. doi:10.1109/tmm.2026.3660108
BibTeX
@article{Huang2026,
author = {Huang, He and Hu, Zixuan and Feng, Dong and Chen, Zhuo and Li, Dongxiao and Liu, Hao and Duan, Lingyu},
title = {Enabling Real-World Supervised Video Anomaly Detection: New Open-Set Benchmark and New Framework},
journal = {IEEE Transactions on Multimedia},
year = {2026},
volume = {28},
pages = {4317--4331},
doi = {10.1109/tmm.2026.3660108}
}
EUVIMED