DoTA: Unsupervised Detection of Traffic Anomaly in Driving Videos
IEEE Transactions on Pattern Analysis and Machine Intelligence · 01.01.2023 · 45 (1) · 444-459
DOI: 10.1109/tpami.2022.3150763 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, erschienen am 01.01.2023. Verfasst von Yu Yao und 6 weiteren Autor:innen. Die Arbeit wurde bisher 135-mal zitiert (Crossref) und nennt 85 Literaturangaben. Gefördert von: National Science Foundation, U.S. Navy, IU Office of the Vice Provost for Research.
Abstract (Originalsprache)
Video anomaly detection (VAD) has been extensively studied for static cameras but is much more challenging in egocentric driving videos where the scenes are extremely dynamic. This paper proposes an unsupervised method for traffic VAD based on future object localization. The idea is to predict future locations of traffic participants over a short horizon, and then monitor the accuracy and consistency of these predictions as evidence of an anomaly. Inconsistent predictions tend to indicate an anomaly has occurred or is about to occur. To evaluate our method, we introduce a new large-scale benchmark dataset called Detection of Traffic Anomaly (DoTA)containing 4,677 videos with temporal, spatial, and categorical annotations. We also propose a new VAD evaluation metric, called spatial-temporal area under curve (STAUC), and show that it captures how well a model detects both temporal and spatial locations of anomalies unlike existing metrics that focus only on temporal localization. Experimental results show our method outperforms state-of-the-art methods on DoTA in terms of both metrics. We offer rich categorical annotations in DoTA to benchmark video action detection and online action detection methods. The DoTA dataset has been made available at: https://github.com/MoonBlvd/Detection-of-Traffic-Anomaly.
Förderung
- National Science Foundation
- U.S. Navy
- IU Office of the Vice Provost for Research
- Luddy School of Informatics, Computing, and Engineering, Indiana University Bloomington
Zitieren
APA
Yao, Y., Wang, X., Xu, M., Pu, Z., Wang, Y., Atkins, E., & Crandall, D. J. (2023). DoTA: Unsupervised Detection of Traffic Anomaly in Driving Videos. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(1), 444-459. https://doi.org/10.1109/tpami.2022.3150763
Vancouver
Yao Y, Wang X, Xu M, Pu Z, Wang Y, Atkins E, et al. DoTA: Unsupervised Detection of Traffic Anomaly in Driving Videos. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2023;45(1):444-459. doi:10.1109/tpami.2022.3150763
BibTeX
@article{Yao2023,
author = {Yao, Yu and Wang, Xizi and Xu, Mingze and Pu, Zelin and Wang, Yuchen and Atkins, Ella and Crandall, David J},
title = {DoTA: Unsupervised Detection of Traffic Anomaly in Driving Videos},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2023},
volume = {45},
number = {1},
pages = {444--459},
doi = {10.1109/tpami.2022.3150763}
}
EUVIMED