EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Unified Explainable Autonomous Driving Framework via Cross-Attention Scene Selection and Semantic–Object Fusion

Habib Dhahri, Fahad Alotaibi, Awais Mahmood, Mousa Jari

Machines · 10.06.2026 · 14 (6) · 677

DOI: 10.3390/machines14060677 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Machines, online erschienen am 10.06.2026. Verfasst von Habib Dhahri und 3 weiteren Autor:innen. Die Arbeit nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: King Saud University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Intelligent autonomous driving systems must not only predict the appropriate driving manoeuvre but also provide human-interpretable evidence that justifies the decision. However, existing methods typically address these objectives separately, leading to three practical limitations: multi-stage perception-to-language pipelines can propagate upstream perception errors into downstream explanations; post hoc saliency methods often produce pixel-level highlights that are difficult to interpret semantically; and decoupled decision and explanation modules cannot guarantee that the explanation reflects the same scene evidence used for behaviour prediction. In this paper, we propose a unified framework that jointly performs vehicle behaviour prediction and human-centric interpretation from a shared visual backbone. Specifically, a hierarchical Swin Transformer encodes the driving scene into a sequence of spatial tokens, which are processed by two complementary branches. The first branch, termed the Object Selection Module (OSM), learns a compact scene-level semantic representation through query-guided cross-attention, while the second branch extracts a small set of class-agnostic object-centric tokens without requiring bounding-box or segmentation supervision. These two representations are subsequently integrated by a Semantic–Object Fusion (SOF) module based on scaled dot-product attention, residual connections, and a feed-forward network. The behaviour prediction head operates on the fused representation, whereas the interpretation head leverages the semantic representation through a skip connection to preserve decision-relevant context. For surround-view perception, learnable per-camera embeddings are introduced to maintain viewpoint identity with negligible additional parameter cost. Furthermore, a compact language model fine-tuned via Low-Rank Adaptation (LoRA) generates fluent, label-conditioned natural-language justifications. Extensive experiments on two public benchmarks, BDD-OIA and nu-AD, demonstrate that the proposed framework consistently delivers superior performance and provides effective, human-readable interpretations of driving decisions.

Förderung

  • King Saud University

Zitieren

APA

Dhahri, H., Alotaibi, F., Mahmood, A., & Jari, M. (2026). A Unified Explainable Autonomous Driving Framework via Cross-Attention Scene Selection and Semantic–Object Fusion. Machines, 14(6), 677. https://doi.org/10.3390/machines14060677

Vancouver

Dhahri H, Alotaibi F, Mahmood A, Jari M. A Unified Explainable Autonomous Driving Framework via Cross-Attention Scene Selection and Semantic–Object Fusion. Machines. 2026;14(6):677. doi:10.3390/machines14060677

BibTeX
@article{Dhahri2026,
  author = {Dhahri, Habib and Alotaibi, Fahad and Mahmood, Awais and Jari, Mousa},
  title = {A Unified Explainable Autonomous Driving Framework via Cross-Attention Scene Selection and Semantic–Object Fusion},
  journal = {Machines},
  year = {2026},
  volume = {14},
  number = {6},
  pages = {677},
  doi = {10.3390/machines14060677}
}
Kostenlos starten →