EUVIMEDEUVIMED entdecken
Crossref

An expert ensemble for detecting anomalous scenes, interactions, and behaviors in autonomous driving

Tianchen Ji, Neeloy Chakraborty, Andre Schreiber, Katherine Driggs-Campbell

The International Journal of Robotics Research · 2025-05 · 44 (6) · 1055-1077

DOI: 10.1177/02783649241297998 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The International Journal of Robotics Research, online erschienen am 21.11.2024. Verfasst von Tianchen Ji und 3 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 78 Literaturangaben. Gefördert von: National Science Foundation, National Robotics Initiative 2.0.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As automated vehicles enter public roads, safety in a near-infinite number of driving scenarios becomes one of the major concerns for the widespread adoption of fully autonomous driving. The ability to detect anomalous situations outside of the operational design domain is a key component in self-driving cars, enabling us to mitigate the impact of abnormal ego behaviors and to realize trustworthy driving systems. On-road anomaly detection in egocentric videos remains a challenging problem due to the difficulties introduced by complex and interactive scenarios. We conduct a holistic analysis of common on-road anomaly patterns, from which we propose three unsupervised anomaly detection experts: a scene expert that focuses on frame-level appearances to detect abnormal scenes and unexpected scene motions; an interaction expert that models normal relative motions between two road participants and raises alarms whenever anomalous interactions emerge; and a behavior expert which monitors abnormal behaviors of individual objects by future trajectory prediction. To combine the strengths of all the modules, we propose an expert ensemble (Xen) using a Kalman filter, in which the final anomaly score is absorbed as one of the states and the observations are generated by the experts. Our experiments employ a novel evaluation protocol for realistic model performance, demonstrate superior anomaly detection performance than previous methods, and show that our framework has potential in classifying anomaly types using unsupervised learning on a large-scale on-road anomaly dataset.

Förderung

  • National Science Foundation
  • National Robotics Initiative 2.0

Zitieren

APA

Ji, T., Chakraborty, N., Schreiber, A., & Driggs-Campbell, K. (2025). An expert ensemble for detecting anomalous scenes, interactions, and behaviors in autonomous driving. The International Journal of Robotics Research, 44(6), 1055-1077. https://doi.org/10.1177/02783649241297998

Vancouver

Ji T, Chakraborty N, Schreiber A, Driggs-Campbell K. An expert ensemble for detecting anomalous scenes, interactions, and behaviors in autonomous driving. The International Journal of Robotics Research. 2025;44(6):1055-1077. doi:10.1177/02783649241297998

BibTeX
@article{Ji2025,
  author = {Ji, Tianchen and Chakraborty, Neeloy and Schreiber, Andre and Driggs-Campbell, Katherine},
  title = {An expert ensemble for detecting anomalous scenes, interactions, and behaviors in autonomous driving},
  journal = {The International Journal of Robotics Research},
  year = {2025},
  volume = {44},
  number = {6},
  pages = {1055--1077},
  doi = {10.1177/02783649241297998}
}
Kostenlos starten →