EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Vision-Language Traffic Sign Recognition for Self-Driving: Robust Classification, Uncertainty Calibration, and LLM Safety Explanations on a GTSRB-Compatible Benchmark

Tong Ye, Ruiyan Ma, Sophia Luo

Journal of Advanced Computing Systems · 20.10.2024 · 4 (10) · 84-102

DOI: 10.69987/jacs.2024.41007 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Advanced Computing Systems, online erschienen am 20.10.2024. Verfasst von Tong Ye und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Traffic-sign recognition is a small-object perception task with direct safety relevance for self-driving systems. This paper reports a complete, reproducible evaluation of robust classification, uncertainty calibration, and language-grounded safety explanations for 43 traffic-sign classes derived from the German Traffic Sign Recognition Benchmark (GTSRB) ontology. The official GTSRB archive was treated as the target domain; however, external binary ZIP downloads were unavailable in the execution environment. Following the experimental fallback rule, the study used a packaged GTSRB-compatible synthetic dataset with 39,209 RGB images, the same 43 class names, the official training-class scale, and deterministic train, validation, and test splits of 27,446, 5,881, and 5,882 images. The visual recognizer combines pooled intensity, HOG edge, and color statistics in a lightweight linear probabilistic classifier. A semantic group head predicts six safety-oriented sign groups, and a language-prior fusion layer combines class and group evidence before temperature scaling. The final model achieved 92.469% top-1 accuracy, 97.042% top-5 accuracy, 84.953% macro F1, 0.421 negative log-likelihood, and 1.433% expected calibration error on the held-out test split. Controlled corruption tests under low light, over-exposure, Gaussian noise, blur, occlusion, and motion blur quantified robustness rather than assuming it. The results show that semantic fusion and calibration improved probability quality on clean data, while HOG-dominant features remained competitive under severe illumination shifts. The explanation module produced deterministic LLM-style safety messages grounded in predicted class, confidence, ontology group, and driving action.

Zitieren

APA

Ye, T., Ma, R., & Luo, S. (2024). Vision-Language Traffic Sign Recognition for Self-Driving: Robust Classification, Uncertainty Calibration, and LLM Safety Explanations on a GTSRB-Compatible Benchmark. Journal of Advanced Computing Systems, 4(10), 84-102. https://doi.org/10.69987/jacs.2024.41007

Vancouver

Ye T, Ma R, Luo S. Vision-Language Traffic Sign Recognition for Self-Driving: Robust Classification, Uncertainty Calibration, and LLM Safety Explanations on a GTSRB-Compatible Benchmark. Journal of Advanced Computing Systems. 2024;4(10):84-102. doi:10.69987/jacs.2024.41007

BibTeX
@article{Ye2024,
  author = {Ye, Tong and Ma, Ruiyan and Luo, Sophia},
  title = {Vision-Language Traffic Sign Recognition for Self-Driving: Robust Classification, Uncertainty Calibration, and LLM Safety Explanations on a GTSRB-Compatible Benchmark},
  journal = {Journal of Advanced Computing Systems},
  year = {2024},
  volume = {4},
  number = {10},
  pages = {84--102},
  doi = {10.69987/jacs.2024.41007}
}
Kostenlos starten →