Towards trustworthy multi‐modal motion prediction: Holistic evaluation and interpretability of outputs
CAAI Transactions on Intelligence Technology · 2024-06 · 9 (3) · 557-572
DOI: 10.1049/cit2.12244 ↗Kurz gefasst
Fachartikel in der Zeitschrift CAAI Transactions on Intelligence Technology, online erschienen am 05.06.2023. Verfasst von Sandra Carrasco Limeros und 5 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministerio de Ciencia e Innovación, Comunidad de Madrid.
Abstract (Originalsprache)
Predicting the motion of other road agents enables autonomous vehicles to perform safe and efficient path planning. This task is very complex, as the behaviour of road agents depends on many factors and the number of possible future trajectories can be considerable (multi‐modal). Most prior approaches proposed to address multi‐modal motion prediction are based on complex machine learning systems that have limited interpretability. Moreover, the metrics used in current benchmarks do not evaluate all aspects of the problem, such as the diversity and admissibility of the output. The authors aim to advance towards the design of trustworthy motion prediction systems, based on some of the requirements for the design of Trustworthy Artificial Intelligence. The focus is on evaluation criteria, robustness, and interpretability of outputs. First, the evaluation metrics are comprehensively analysed, the main gaps of current benchmarks are identified, and a new holistic evaluation framework is proposed. Then, a method for the assessment of spatial and temporal robustness is introduced by simulating noise in the perception system. To enhance the interpretability of the outputs and generate more balanced results in the proposed evaluation framework, an intent prediction layer that can be attached to multi‐modal motion prediction models is proposed. The effectiveness of this approach is assessed through a survey that explores different elements in the visualisation of the multi‐modal trajectories and intentions. The proposed approach and findings make a significant contribution to the development of trustworthy motion prediction systems for autonomous vehicles, advancing the field towards greater safety and reliability.
Förderung
- Ministerio de Ciencia e Innovación
- Comunidad de Madrid
Zitieren
APA
Limeros, S. C., Majchrowska, S., Johnander, J., Petersson, C., Sotelo, M. Á., & Llorca, D. F. (2024). Towards trustworthy multi‐modal motion prediction: Holistic evaluation and interpretability of outputs. CAAI Transactions on Intelligence Technology, 9(3), 557-572. https://doi.org/10.1049/cit2.12244
Vancouver
Limeros SC, Majchrowska S, Johnander J, Petersson C, Sotelo MÁ, Llorca DF. Towards trustworthy multi‐modal motion prediction: Holistic evaluation and interpretability of outputs. CAAI Transactions on Intelligence Technology. 2024;9(3):557-572. doi:10.1049/cit2.12244
BibTeX
@article{Limeros2024,
author = {Limeros, Sandra Carrasco and Majchrowska, Sylwia and Johnander, Joakim and Petersson, Christoffer and Sotelo, Miguel Ángel and Llorca, David Fernández},
title = {Towards trustworthy multi‐modal motion prediction: Holistic evaluation and interpretability of outputs},
journal = {CAAI Transactions on Intelligence Technology},
year = {2024},
volume = {9},
number = {3},
pages = {557--572},
doi = {10.1049/cit2.12244}
}
EUVIMED