EUVIMEDEUVIMED entdecken
Crossref

Benchmarking and Improving Bird’s Eye View Perception Robustness in Autonomous Driving

Shaoyuan Xie, Lingdong Kong, Wenwei Zhang, Jiawei Ren, Liang Pan, Kai Chen, Ziwei Liu

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025-05 · 47 (5) · 3878-3894

DOI: 10.1109/tpami.2025.3535960 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025-05. Verfasst von Shaoyuan Xie und 6 weiteren Autor:innen. Die Arbeit wurde bisher 37-mal zitiert (Crossref) und nennt 123 Literaturangaben. Gefördert von: National Key R&D Program of China, Ministry of Education - Singapore, MOE AcRF Tier 2.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent advancements in bird's eye view (BEV) representations have shown remarkable promise for in-vehicle 3D perception. However, while these methods have achieved impressive results on standard benchmarks, their robustness in varied conditions remains insufficiently assessed. In this study, we present RoboBEV, an extensive benchmark suite designed to evaluate the resilience of BEV algorithms. This suite incorporates a diverse set of camera corruption types, each examined over three severity levels. Our benchmarks also consider the impact of complete sensor failures that occur when using multi-modal models. Through RoboBEV, we assess 33 state-of-the-art BEV-based perception models spanning tasks like detection, map segmentation, depth estimation, and occupancy prediction. Our analyses reveal a noticeable correlation between the model's performance on in-distribution datasets and its resilience to out-of-distribution challenges. Our experimental results also underline the efficacy of strategies like pre-training and depth-free BEV transformations in enhancing robustness against out-of-distribution data. Furthermore, we observe that leveraging extensive temporal information significantly improves the model's robustness. Based on our observations, we design an effective robustness enhancement strategy based on the CLIP model. The insights from this study pave the way for the development of future BEV models that seamlessly combine accuracy with real-world robustness.

Förderung

  • National Key R&D Program of China
  • Ministry of Education - Singapore
  • MOE AcRF Tier 2
  • Industry Alignment Fund – Industry Collaboration Projects (IAF-ICP) Funding Initiative

Zitieren

APA

Xie, S., Kong, L., Zhang, W., Ren, J., Pan, L., Chen, K., & Liu, Z. (2025). Benchmarking and Improving Bird’s Eye View Perception Robustness in Autonomous Driving. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(5), 3878-3894. https://doi.org/10.1109/tpami.2025.3535960

Vancouver

Xie S, Kong L, Zhang W, Ren J, Pan L, Chen K, et al. Benchmarking and Improving Bird’s Eye View Perception Robustness in Autonomous Driving. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2025;47(5):3878-3894. doi:10.1109/tpami.2025.3535960

BibTeX
@article{Xie2025,
  author = {Xie, Shaoyuan and Kong, Lingdong and Zhang, Wenwei and Ren, Jiawei and Pan, Liang and Chen, Kai and Liu, Ziwei},
  title = {Benchmarking and Improving Bird’s Eye View Perception Robustness in Autonomous Driving},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2025},
  volume = {47},
  number = {5},
  pages = {3878--3894},
  doi = {10.1109/tpami.2025.3535960}
}
Kostenlos starten →