EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Situational perception in distracted driving: an agentic multi-modal LLM framework

Ahmad M Nazar, Mohamed Y Selim, Ashraf Gaffar, Daji Qiao

Frontiers in Artificial Intelligence · 15.10.2025 · 8

DOI: 10.3389/frai.2025.1669937 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Artificial Intelligence, online erschienen am 15.10.2025. Verfasst von Ahmad M Nazar und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical and Computer Engineering, Iowa State University, Ames, IA, United States. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 19 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

Distracted driving is a significant public safety concern, causing thousands of accidents annually. While most driver assistance systems emphasize distraction detection, they fail to deliver real-time environmental perception and context-aware interventions.

Methods

We propose a large language model (LLM)-driven intervention framework that assumes distraction is pre-detected and dynamically integrates camera and GPS inputs to generate verbal driver alerts. The framework employs an agentic design, where specialized tools handle object detection, speed limits, live traffic conditions, and weather data. Structured orchestration ensures information is fused efficiently, balancing accuracy with conciseness to avoid overwhelming the driver.

Results

Evaluation of the system demonstrates high performance, with semantic intervention correctness of 85.7% and an average response latency of 1.74 s. Compared to conventional ML-based driver assistance approaches, our framework effectively synthesizes multi-modal environmental data and produces actionable alerts in real time. Discussion/conclusion These findings highlight the potential of LLM-driven, multi-modal reasoning for distracted driving intervention. Integrating specialized agents and structured orchestration improves situational awareness, maintains concise communication, and meets real-time safety requirements. This proof-of-concept establishes a pathway for deploying intelligent, AI-driven driver support systems in safety-critical applications.

Schlagwörter

Stichwörter der Autor:innen

LLMLLM agentsdata-drivendistracted drivingmulti-modalperceptionsituational awareness

Autor:innen und Institutionen

  • Department of Electrical and Computer Engineering, Iowa State University, Ames, IA, United States.

Zitieren

APA

Nazar, A. M., Selim, M. Y., Gaffar, A., & Qiao, D. (2025). Situational perception in distracted driving: an agentic multi-modal LLM framework. Frontiers in Artificial Intelligence, 8. https://doi.org/10.3389/frai.2025.1669937

Vancouver

Nazar AM, Selim MY, Gaffar A, Qiao D. Situational perception in distracted driving: an agentic multi-modal LLM framework. Frontiers in Artificial Intelligence. 2025;8. doi:10.3389/frai.2025.1669937

BibTeX
@article{Nazar2025,
  author = {Nazar, Ahmad M and Selim, Mohamed Y and Gaffar, Ashraf and Qiao, Daji},
  title = {Situational perception in distracted driving: an agentic multi-modal LLM framework},
  journal = {Frontiers in Artificial Intelligence},
  year = {2025},
  volume = {8},
  doi = {10.3389/frai.2025.1669937}
}
Kostenlos starten →