OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Model
Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (16) · 13782-13790
DOI: 10.1609/aaai.v40i16.38386 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Xingcheng Zhou und 5 weiteren Autor:innen. Die Arbeit wurde bisher 40-mal zitiert (Crossref).
Abstract (Originalsprache)
We present OpenDriveVLA, a Vision-Language Action (VLA) model designed for end-to-end autonomous driving, built upon open-source large language models. OpenDriveVLA generates spatially-grounded driving actions by leveraging multimodal inputs, including both 2D and 3D instance-aware visual representations, ego vehicle states, and language commands. To bridge the modality gap between driving visual representations and language embeddings, we introduce a hierarchical vision-language alignment process, projecting both 2D and 3D structured visual tokens into a unified semantic space. Furthermore, we incorporate structured agent–environment–ego interaction modeling into the autoregressive decoding process, enabling the model to capture fine-grained spatial dependencies and behavior-aware dynamics critical for reliable trajectory planning. Extensive experiments on the nuScenes dataset demonstrate that OpenDriveVLA achieves state-of-the-art results across open-loop trajectory planning and driving-related question-answering tasks. Qualitative analyses further illustrate its superior capability to follow high-level driving commands and robustly generate trajectories under challenging scenarios, highlighting its potential for next-generation end-to-end autonomous driving.
Zitieren
APA
Zhou, X., Han, X., Yang, F., Ma, Y., Tresp, V., & Knoll, A. (2026). OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Model. Proceedings of the AAAI Conference on Artificial Intelligence, 40(16), 13782-13790. https://doi.org/10.1609/aaai.v40i16.38386
Vancouver
Zhou X, Han X, Yang F, Ma Y, Tresp V, Knoll A. OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Model. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(16):13782-13790. doi:10.1609/aaai.v40i16.38386
BibTeX
@article{Zhou2026,
author = {Zhou, Xingcheng and Han, Xuyuan and Yang, Feng and Ma, Yunpu and Tresp, Volker and Knoll, Alois},
title = {OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Model},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2026},
volume = {40},
number = {16},
pages = {13782--13790},
doi = {10.1609/aaai.v40i16.38386}
}
EUVIMED