EUVIMEDEUVIMED entdecken
Crossref

VLScene: Vision-Language Guidance Distillation for Camera-Based 3D Semantic Scene Completion

Meng Wang, Huilong Pi, Ruihui Li, Yunchuan Qin, Zhuo Tang, Kenli Li

Proceedings of the AAAI Conference on Artificial Intelligence · 11.04.2025 · 39 (8) · 7808-7816

DOI: 10.1609/aaai.v39i8.32841 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 11.04.2025. Verfasst von Meng Wang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Camera-based 3D semantic scene completion (SSC) provides dense geometric and semantic perception for autonomous driving. However, images provide limited information making the model susceptible to geometric ambiguity caused by occlusion and perspective distortion. Existing methods often lack explicit semantic modeling between objects, limiting their perception of 3D semantic context. To address these challenges, we propose a novel method VLScene: Vision-Language Guidance Distillation for Camera-based 3D Semantic Scene Completion. The key insight is to use the vision-language model to introduce high-level semantic priors to provide the object spatial context required for 3D scene understanding. Specifically, we design a vision-language guidance distillation process to enhance image features, which can effectively capture semantic knowledge from the surrounding environment and improve spatial context reasoning. In addition, we introduce a geometric-semantic sparse awareness mechanism to propagate geometric structures in the neighborhood and enhance semantic information through contextual sparse interactions. Experimental results demonstrate that VLScene achieves rank-1st performance on challenging benchmarks—SemanticKITTI and SSCBench-KITTI-360, yielding remarkably mIoU scores of 17.52 and 19.10, respectively.

Zitieren

APA

Wang, M., Pi, H., Li, R., Qin, Y., Tang, Z., & Li, K. (2025). VLScene: Vision-Language Guidance Distillation for Camera-Based 3D Semantic Scene Completion. Proceedings of the AAAI Conference on Artificial Intelligence, 39(8), 7808-7816. https://doi.org/10.1609/aaai.v39i8.32841

Vancouver

Wang M, Pi H, Li R, Qin Y, Tang Z, Li K. VLScene: Vision-Language Guidance Distillation for Camera-Based 3D Semantic Scene Completion. Proceedings of the AAAI Conference on Artificial Intelligence. 2025;39(8):7808-7816. doi:10.1609/aaai.v39i8.32841

BibTeX
@article{Wang2025,
  author = {Wang, Meng and Pi, Huilong and Li, Ruihui and Qin, Yunchuan and Tang, Zhuo and Li, Kenli},
  title = {VLScene: Vision-Language Guidance Distillation for Camera-Based 3D Semantic Scene Completion},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2025},
  volume = {39},
  number = {8},
  pages = {7808--7816},
  doi = {10.1609/aaai.v39i8.32841}
}
Kostenlos starten →