An expert ensemble for detecting anomalous scenes, interactions, and behaviors in autonomous driving
The International Journal of Robotics Research · 2025-05 · 44 (6) · 1055-1077
DOI: 10.1177/02783649241297998 ↗Kurz gefasst
Fachartikel in der Zeitschrift The International Journal of Robotics Research, online erschienen am 21.11.2024. Verfasst von Tianchen Ji und 3 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 78 Literaturangaben. Gefördert von: National Science Foundation, National Robotics Initiative 2.0.
Abstract (Originalsprache)
As automated vehicles enter public roads, safety in a near-infinite number of driving scenarios becomes one of the major concerns for the widespread adoption of fully autonomous driving. The ability to detect anomalous situations outside of the operational design domain is a key component in self-driving cars, enabling us to mitigate the impact of abnormal ego behaviors and to realize trustworthy driving systems. On-road anomaly detection in egocentric videos remains a challenging problem due to the difficulties introduced by complex and interactive scenarios. We conduct a holistic analysis of common on-road anomaly patterns, from which we propose three unsupervised anomaly detection experts: a scene expert that focuses on frame-level appearances to detect abnormal scenes and unexpected scene motions; an interaction expert that models normal relative motions between two road participants and raises alarms whenever anomalous interactions emerge; and a behavior expert which monitors abnormal behaviors of individual objects by future trajectory prediction. To combine the strengths of all the modules, we propose an expert ensemble (Xen) using a Kalman filter, in which the final anomaly score is absorbed as one of the states and the observations are generated by the experts. Our experiments employ a novel evaluation protocol for realistic model performance, demonstrate superior anomaly detection performance than previous methods, and show that our framework has potential in classifying anomaly types using unsupervised learning on a large-scale on-road anomaly dataset.
Förderung
- National Science Foundation
- National Robotics Initiative 2.0
Zitieren
APA
Ji, T., Chakraborty, N., Schreiber, A., & Driggs-Campbell, K. (2025). An expert ensemble for detecting anomalous scenes, interactions, and behaviors in autonomous driving. The International Journal of Robotics Research, 44(6), 1055-1077. https://doi.org/10.1177/02783649241297998
Vancouver
Ji T, Chakraborty N, Schreiber A, Driggs-Campbell K. An expert ensemble for detecting anomalous scenes, interactions, and behaviors in autonomous driving. The International Journal of Robotics Research. 2025;44(6):1055-1077. doi:10.1177/02783649241297998
BibTeX
@article{Ji2025,
author = {Ji, Tianchen and Chakraborty, Neeloy and Schreiber, Andre and Driggs-Campbell, Katherine},
title = {An expert ensemble for detecting anomalous scenes, interactions, and behaviors in autonomous driving},
journal = {The International Journal of Robotics Research},
year = {2025},
volume = {44},
number = {6},
pages = {1055--1077},
doi = {10.1177/02783649241297998}
}
EUVIMED