Can LVLMs Obtain a Driver’s License? A Benchmark Towards Reliable AGI for Autonomous Driving
Proceedings of the AAAI Conference on Artificial Intelligence · 11.04.2025 · 39 (6) · 5838-5846
DOI: 10.1609/aaai.v39i6.32623 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 11.04.2025. Verfasst von Yuhang Lu und 5 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref).
Abstract (Originalsprache)
Large Vision-Language Models (LVLMs) have recently garnered significant attention, with many efforts aimed at harnessing their general knowledge to enhance the interpretability and robustness of autonomous driving models. However, LVLMs typically rely on large, general-purpose datasets and lack the specialized expertise required for professional and safe driving. Existing vision-language driving datasets focus primarily on scene understanding and decision-making, without providing explicit guidance on traffic rules and driving skills, which are critical aspects directly related to driving safety. To bridge this gap, we propose IDKB, a large-scale dataset containing over one million data items collected from various countries, including driving handbooks, theory test data, and simulated road test data. Much like the process of obtaining a driver's license, IDKB encompasses nearly all the explicit knowledge needed for driving from theory to practice. In particular, we conducted comprehensive tests on 15 LVLMs using IDKB to assess their reliability in the context of autonomous driving and provided extensive analysis. We also fine-tuned popular models, achieving notable performance improvements, which further validate the significance of our dataset.
Zitieren
APA
Lu, Y., Yao, Y., Tu, J., Shao, J., Ma, Y., & Zhu, X. (2025). Can LVLMs Obtain a Driver’s License? A Benchmark Towards Reliable AGI for Autonomous Driving. Proceedings of the AAAI Conference on Artificial Intelligence, 39(6), 5838-5846. https://doi.org/10.1609/aaai.v39i6.32623
Vancouver
Lu Y, Yao Y, Tu J, Shao J, Ma Y, Zhu X. Can LVLMs Obtain a Driver’s License? A Benchmark Towards Reliable AGI for Autonomous Driving. Proceedings of the AAAI Conference on Artificial Intelligence. 2025;39(6):5838-5846. doi:10.1609/aaai.v39i6.32623
BibTeX
@article{Lu2025,
author = {Lu, Yuhang and Yao, Yichen and Tu, Jiadong and Shao, Jiangnan and Ma, Yuexin and Zhu, Xinge},
title = {Can LVLMs Obtain a Driver’s License? A Benchmark Towards Reliable AGI for Autonomous Driving},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2025},
volume = {39},
number = {6},
pages = {5838--5846},
doi = {10.1609/aaai.v39i6.32623}
}
EUVIMED