EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Vision Language Models in Autonomous Driving: A Survey and Outlook

Xingcheng Zhou, Mingyu Liu, Ekim Yurtsever, Bare Luka Zagar, Walter Zimmer, Hu Cao, Alois C. Knoll

IEEE Transactions on Intelligent Vehicles · 2025 · 1-20

DOI: 10.1109/tiv.2024.3402136 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Vehicles, 2025. Verfasst von Xingcheng Zhou und 6 weiteren Autor:innen. Die Arbeit wurde bisher 133-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: AUTOtech.agil.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The applications of Vision-Language Models (VLMs) in the field of Autonomous Driving (AD) have attracted widespread attention due to their outstanding performance and the ability to leverage Large Language Models (LLMs). By incorporating language data, driving systems can gain a better understanding of real-world environments, thereby enhancing driving safety and efficiency. In this work, we present a comprehensive and systematic survey of the advances in vision language models in this domain, encompassing perception and understanding, navigation and planning, decision-making and control, end-to-end autonomous driving, and data generation. We introduce the mainstream VLM tasks in AD and the commonly utilized metrics. Additionally, we review current studies and applications in various areas and summarize the existing language-enhanced autonomous driving datasets thoroughly. Lastly, we discuss the benefits and challenges of VLMs in AD and provide researchers with the current research gaps and future trends.

Förderung

  • AUTOtech.agil

Zitieren

APA

Zhou, X., Liu, M., Yurtsever, E., Zagar, B. L., Zimmer, W., Cao, H., & Knoll, A. C. (2025). Vision Language Models in Autonomous Driving: A Survey and Outlook. IEEE Transactions on Intelligent Vehicles, 1-20. https://doi.org/10.1109/tiv.2024.3402136

Vancouver

Zhou X, Liu M, Yurtsever E, Zagar BL, Zimmer W, Cao H, et al. Vision Language Models in Autonomous Driving: A Survey and Outlook. IEEE Transactions on Intelligent Vehicles. 2025:1-20. doi:10.1109/tiv.2024.3402136

BibTeX
@article{Zhou2025,
  author = {Zhou, Xingcheng and Liu, Mingyu and Yurtsever, Ekim and Zagar, Bare Luka and Zimmer, Walter and Cao, Hu and Knoll, Alois C.},
  title = {Vision Language Models in Autonomous Driving: A Survey and Outlook},
  journal = {IEEE Transactions on Intelligent Vehicles},
  year = {2025},
  pages = {1--20},
  doi = {10.1109/tiv.2024.3402136}
}
Kostenlos starten →