Benchmarking and Improving Bird’s Eye View Perception Robustness in Autonomous Driving
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025-05 · 47 (5) · 3878-3894
DOI: 10.1109/tpami.2025.3535960 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025-05. Verfasst von Shaoyuan Xie und 6 weiteren Autor:innen. Die Arbeit wurde bisher 37-mal zitiert (Crossref) und nennt 123 Literaturangaben. Gefördert von: National Key R&D Program of China, Ministry of Education - Singapore, MOE AcRF Tier 2.
Abstract (Originalsprache)
Recent advancements in bird's eye view (BEV) representations have shown remarkable promise for in-vehicle 3D perception. However, while these methods have achieved impressive results on standard benchmarks, their robustness in varied conditions remains insufficiently assessed. In this study, we present RoboBEV, an extensive benchmark suite designed to evaluate the resilience of BEV algorithms. This suite incorporates a diverse set of camera corruption types, each examined over three severity levels. Our benchmarks also consider the impact of complete sensor failures that occur when using multi-modal models. Through RoboBEV, we assess 33 state-of-the-art BEV-based perception models spanning tasks like detection, map segmentation, depth estimation, and occupancy prediction. Our analyses reveal a noticeable correlation between the model's performance on in-distribution datasets and its resilience to out-of-distribution challenges. Our experimental results also underline the efficacy of strategies like pre-training and depth-free BEV transformations in enhancing robustness against out-of-distribution data. Furthermore, we observe that leveraging extensive temporal information significantly improves the model's robustness. Based on our observations, we design an effective robustness enhancement strategy based on the CLIP model. The insights from this study pave the way for the development of future BEV models that seamlessly combine accuracy with real-world robustness.
Förderung
- National Key R&D Program of China
- Ministry of Education - Singapore
- MOE AcRF Tier 2
- Industry Alignment Fund – Industry Collaboration Projects (IAF-ICP) Funding Initiative
Zitieren
APA
Xie, S., Kong, L., Zhang, W., Ren, J., Pan, L., Chen, K., & Liu, Z. (2025). Benchmarking and Improving Bird’s Eye View Perception Robustness in Autonomous Driving. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(5), 3878-3894. https://doi.org/10.1109/tpami.2025.3535960
Vancouver
Xie S, Kong L, Zhang W, Ren J, Pan L, Chen K, et al. Benchmarking and Improving Bird’s Eye View Perception Robustness in Autonomous Driving. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2025;47(5):3878-3894. doi:10.1109/tpami.2025.3535960
BibTeX
@article{Xie2025,
author = {Xie, Shaoyuan and Kong, Lingdong and Zhang, Wenwei and Ren, Jiawei and Pan, Liang and Chen, Kai and Liu, Ziwei},
title = {Benchmarking and Improving Bird’s Eye View Perception Robustness in Autonomous Driving},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2025},
volume = {47},
number = {5},
pages = {3878--3894},
doi = {10.1109/tpami.2025.3535960}
}
EUVIMED