EUVIMEDEUVIMED entdecken
Crossref

Receive, Reason, and React: Drive as You Say, With Large Language Models in Autonomous Vehicles

Can Cui, Yunsheng Ma, Xu Cao, Wenqian Ye, Ziran Wang

IEEE Intelligent Transportation Systems Magazine · 2024-07 · 16 (4) · 81-94

DOI: 10.1109/mits.2024.3381793 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Intelligent Transportation Systems Magazine, 2024-07. Verfasst von Can Cui und 4 weiteren Autor:innen. Die Arbeit wurde bisher 108-mal zitiert (Crossref) und nennt 61 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The fusion of human-centric design and artificial intelligence capabilities has opened up new possibilities for next-generation autonomous vehicles that go beyond traditional transportation. These vehicles can dynamically interact with passengers and adapt to their preferences. This article proposes a novel framework that leverages large language models (LLMs) to enhance the decision-making process in autonomous vehicles. By utilizing LLMs’ contextual understanding abilities with specialized tools, we aim to integrate the language and reasoning capabilities of LLMs into autonomous vehicles. Our research includes experiments in HighwayEnv, a collection of environments for autonomous driving and tactical decision-making tasks, to explore LLMs’ interpretation, interaction, and reasoning in various scenarios. We also examine some well-defined real-time personalized driving tasks, demonstrating how LLMs can influence driving behaviors based on drivers’ verbal commands. Our empirical results highlight the substantial advantages of utilizing chain-of-thought prompting, leading to improved driving decisions and showing the potential for LLMs to enhance personalized driving experiences through ongoing verbal feedback. The proposed framework aims to transform autonomous vehicle operations, offering personalized support, transparent decision making, and continuous learning to enhance safety and effectiveness. We achieve user-centric, transparent, and adaptive autonomous driving ecosystems supported by the integration of LLMs into autonomous vehicles. Experiment videos are available at https://youtube.com/playlist?list=PLgcRcf9w8BmLJi_fqTGq-7KCZsbpEIE4a&si=dhH9lgaeSmB5K94t.

Zitieren

APA

Cui, C., Ma, Y., Cao, X., Ye, W., & Wang, Z. (2024). Receive, Reason, and React: Drive as You Say, With Large Language Models in Autonomous Vehicles. IEEE Intelligent Transportation Systems Magazine, 16(4), 81-94. https://doi.org/10.1109/mits.2024.3381793

Vancouver

Cui C, Ma Y, Cao X, Ye W, Wang Z. Receive, Reason, and React: Drive as You Say, With Large Language Models in Autonomous Vehicles. IEEE Intelligent Transportation Systems Magazine. 2024;16(4):81-94. doi:10.1109/mits.2024.3381793

BibTeX
@article{Cui2024,
  author = {Cui, Can and Ma, Yunsheng and Cao, Xu and Ye, Wenqian and Wang, Ziran},
  title = {Receive, Reason, and React: Drive as You Say, With Large Language Models in Autonomous Vehicles},
  journal = {IEEE Intelligent Transportation Systems Magazine},
  year = {2024},
  volume = {16},
  number = {4},
  pages = {81--94},
  doi = {10.1109/mits.2024.3381793}
}
Kostenlos starten →