EUVIMEDEUVIMED entdecken
Crossref

SGVLM : Depth‐Integrated Semantic Scene Graph Fusion for Enhanced Autonomous Driving Decision‐Making

Yiming Han, Yiran Tao, Xiang Cui, Tinglun Song

Computational Intelligence · 2026-04 · 42 (2)

DOI: 10.1111/coin.70223 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computational Intelligence, online erschienen am 13.04.2026. Verfasst von Yiming Han und 3 weiteren Autor:innen. Die Arbeit nennt 28 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Autonomous driving decision‐making requires a deep semantic understanding of traffic scenes. In this paper, we propose the SGVLM (Semantic Graph Vision‐Language Model) architecture: a vision‐language model that enhances autonomous driving decision‐making through depth‐integrated semantic scene graph fusion. Key objects are represented as nodes (category, state) and spatial‐semantic relations as edges, enriched with pixel‐wise depth estimates from Depth‐Anything‐V2 to capture accurate inter‐object distances. These structured graph features are aggregated via a two‐layer Graph Attention Network and projected into the FastVLM's FastViTHD feature space. A cross‐modal triplet fusion layer then jointly integrates graph embeddings, visual features, and natural‐language queries. Crucially, to ensure computational efficiency without compromising the generalization power of the large‐scale backbone, we employ Low‐Rank Adaptation (LoRA), which significantly reduces the number of trainable parameters and accelerates convergence while maintaining pre‐trained performance. Empirical validation on the DriveLM‐nuScenes benchmark demonstrates that SGVLM_7B achieves relative improvements of 25.9% in BLEU‐4 and 18.6% in ROUGE‐L over the InternVL4Drive‐v2 baseline, and attains 94.56% accuracy on collision‐warning decision tasks in our TTSG‐data safety‐critical scenarios. These results confirm that depth‐integrated semantic scene graph fusion substantially enhances the model's ability to generate actionable driving decisions under complex traffic conditions.

Zitieren

APA

Han, Y., Tao, Y., Cui, X., & Song, T. (2026). SGVLM : Depth‐Integrated Semantic Scene Graph Fusion for Enhanced Autonomous Driving Decision‐Making. Computational Intelligence, 42(2). https://doi.org/10.1111/coin.70223

Vancouver

Han Y, Tao Y, Cui X, Song T. SGVLM : Depth‐Integrated Semantic Scene Graph Fusion for Enhanced Autonomous Driving Decision‐Making. Computational Intelligence. 2026;42(2). doi:10.1111/coin.70223

BibTeX
@article{Han2026,
  author = {Han, Yiming and Tao, Yiran and Cui, Xiang and Song, Tinglun},
  title = {SGVLM : Depth‐Integrated Semantic Scene Graph Fusion for Enhanced Autonomous Driving Decision‐Making},
  journal = {Computational Intelligence},
  year = {2026},
  volume = {42},
  number = {2},
  doi = {10.1111/coin.70223}
}
Kostenlos starten →