EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Vision‐Language Hazard Reasoning for Driver Distraction and Workload Estimation

Stephanie Ng, Hailing Zhou, Adetokunbo Arogbonlo, Chee Peng Lim, Saeid Nahavandi

Electronics Letters · 2025-01 · 61 (1)

DOI: 10.1049/ell2.70466 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics Letters, online erschienen am 06.11.2025. Verfasst von Stephanie Ng und 4 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 11 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Swinburne University of Technology.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Driver distraction and cognitive overload are major contributors to road accidents, especially in semi‐automated driving where humans must remain situationally aware. We propose an agentic reasoning approach for jointly detecting external driving hazards and inferring internal driver workload, such as distraction and cognitive overload, through a vision‐language‐model (VLM)‐centric framework. The proposed framework interprets driving scenes alongside customisable natural language‐based safety rules, enabling context‐sensitive hazard reasoning. It classifies scene complexity as a proxy for cognitive task demand and selectively invokes multimodal tools to further refine risk assessment based on task complexity or uncertainty. As a pilot study, we evaluate the framework's capacity for hazard comprehension using a curated set of driving scene images, sampled across five rule domains: driver distraction, traffic rules, pedestrian behaviour, road condition and vehicle load safety. Preliminary results demonstrate that the VLM‐based method can correctly identify safety rule violations and provide interpretable rationales for explaining cases.

Förderung

  • Swinburne University of Technology

Zitieren

APA

Ng, S., Zhou, H., Arogbonlo, A., Lim, C. P., & Nahavandi, S. (2025). Vision‐Language Hazard Reasoning for Driver Distraction and Workload Estimation. Electronics Letters, 61(1). https://doi.org/10.1049/ell2.70466

Vancouver

Ng S, Zhou H, Arogbonlo A, Lim CP, Nahavandi S. Vision‐Language Hazard Reasoning for Driver Distraction and Workload Estimation. Electronics Letters. 2025;61(1). doi:10.1049/ell2.70466

BibTeX
@article{Ng2025,
  author = {Ng, Stephanie and Zhou, Hailing and Arogbonlo, Adetokunbo and Lim, Chee Peng and Nahavandi, Saeid},
  title = {Vision‐Language Hazard Reasoning for Driver Distraction and Workload Estimation},
  journal = {Electronics Letters},
  year = {2025},
  volume = {61},
  number = {1},
  doi = {10.1049/ell2.70466}
}
Kostenlos starten →