EUVIMEDEUVIMED entdecken
Crossref

OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Model

Xingcheng Zhou, Xuyuan Han, Feng Yang, Yunpu Ma, Volker Tresp, Alois Knoll

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (16) · 13782-13790

DOI: 10.1609/aaai.v40i16.38386 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Xingcheng Zhou und 5 weiteren Autor:innen. Die Arbeit wurde bisher 40-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We present OpenDriveVLA, a Vision-Language Action (VLA) model designed for end-to-end autonomous driving, built upon open-source large language models. OpenDriveVLA generates spatially-grounded driving actions by leveraging multimodal inputs, including both 2D and 3D instance-aware visual representations, ego vehicle states, and language commands. To bridge the modality gap between driving visual representations and language embeddings, we introduce a hierarchical vision-language alignment process, projecting both 2D and 3D structured visual tokens into a unified semantic space. Furthermore, we incorporate structured agent–environment–ego interaction modeling into the autoregressive decoding process, enabling the model to capture fine-grained spatial dependencies and behavior-aware dynamics critical for reliable trajectory planning. Extensive experiments on the nuScenes dataset demonstrate that OpenDriveVLA achieves state-of-the-art results across open-loop trajectory planning and driving-related question-answering tasks. Qualitative analyses further illustrate its superior capability to follow high-level driving commands and robustly generate trajectories under challenging scenarios, highlighting its potential for next-generation end-to-end autonomous driving.

Zitieren

APA

Zhou, X., Han, X., Yang, F., Ma, Y., Tresp, V., & Knoll, A. (2026). OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Model. Proceedings of the AAAI Conference on Artificial Intelligence, 40(16), 13782-13790. https://doi.org/10.1609/aaai.v40i16.38386

Vancouver

Zhou X, Han X, Yang F, Ma Y, Tresp V, Knoll A. OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Model. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(16):13782-13790. doi:10.1609/aaai.v40i16.38386

BibTeX
@article{Zhou2026,
  author = {Zhou, Xingcheng and Han, Xuyuan and Yang, Feng and Ma, Yunpu and Tresp, Volker and Knoll, Alois},
  title = {OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Model},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {16},
  pages = {13782--13790},
  doi = {10.1609/aaai.v40i16.38386}
}
Kostenlos starten →