Situational perception in distracted driving: an agentic multi-modal LLM framework
Frontiers in Artificial Intelligence · 15.10.2025 · 8
DOI: 10.3389/frai.2025.1669937 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Artificial Intelligence, online erschienen am 15.10.2025. Verfasst von Ahmad M Nazar und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical and Computer Engineering, Iowa State University, Ames, IA, United States. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 19 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Introduction
Distracted driving is a significant public safety concern, causing thousands of accidents annually. While most driver assistance systems emphasize distraction detection, they fail to deliver real-time environmental perception and context-aware interventions.
Methods
We propose a large language model (LLM)-driven intervention framework that assumes distraction is pre-detected and dynamically integrates camera and GPS inputs to generate verbal driver alerts. The framework employs an agentic design, where specialized tools handle object detection, speed limits, live traffic conditions, and weather data. Structured orchestration ensures information is fused efficiently, balancing accuracy with conciseness to avoid overwhelming the driver.
Results
Evaluation of the system demonstrates high performance, with semantic intervention correctness of 85.7% and an average response latency of 1.74 s. Compared to conventional ML-based driver assistance approaches, our framework effectively synthesizes multi-modal environmental data and produces actionable alerts in real time. Discussion/conclusion These findings highlight the potential of LLM-driven, multi-modal reasoning for distracted driving intervention. Integrating specialized agents and structured orchestration improves situational awareness, maintains concise communication, and meets real-time safety requirements. This proof-of-concept establishes a pathway for deploying intelligent, AI-driven driver support systems in safety-critical applications.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Electrical and Computer Engineering, Iowa State University, Ames, IA, United States.
Zitieren
APA
Nazar, A. M., Selim, M. Y., Gaffar, A., & Qiao, D. (2025). Situational perception in distracted driving: an agentic multi-modal LLM framework. Frontiers in Artificial Intelligence, 8. https://doi.org/10.3389/frai.2025.1669937
Vancouver
Nazar AM, Selim MY, Gaffar A, Qiao D. Situational perception in distracted driving: an agentic multi-modal LLM framework. Frontiers in Artificial Intelligence. 2025;8. doi:10.3389/frai.2025.1669937
BibTeX
@article{Nazar2025,
author = {Nazar, Ahmad M and Selim, Mohamed Y and Gaffar, Ashraf and Qiao, Daji},
title = {Situational perception in distracted driving: an agentic multi-modal LLM framework},
journal = {Frontiers in Artificial Intelligence},
year = {2025},
volume = {8},
doi = {10.3389/frai.2025.1669937}
}
EUVIMED