Vision-Language Traffic Sign Recognition for Self-Driving: Robust Classification, Uncertainty Calibration, and LLM Safety Explanations on a GTSRB-Compatible Benchmark
Journal of Advanced Computing Systems · 20.10.2024 · 4 (10) · 84-102
DOI: 10.69987/jacs.2024.41007 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Advanced Computing Systems, online erschienen am 20.10.2024. Verfasst von Tong Ye und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Traffic-sign recognition is a small-object perception task with direct safety relevance for self-driving systems. This paper reports a complete, reproducible evaluation of robust classification, uncertainty calibration, and language-grounded safety explanations for 43 traffic-sign classes derived from the German Traffic Sign Recognition Benchmark (GTSRB) ontology. The official GTSRB archive was treated as the target domain; however, external binary ZIP downloads were unavailable in the execution environment. Following the experimental fallback rule, the study used a packaged GTSRB-compatible synthetic dataset with 39,209 RGB images, the same 43 class names, the official training-class scale, and deterministic train, validation, and test splits of 27,446, 5,881, and 5,882 images. The visual recognizer combines pooled intensity, HOG edge, and color statistics in a lightweight linear probabilistic classifier. A semantic group head predicts six safety-oriented sign groups, and a language-prior fusion layer combines class and group evidence before temperature scaling. The final model achieved 92.469% top-1 accuracy, 97.042% top-5 accuracy, 84.953% macro F1, 0.421 negative log-likelihood, and 1.433% expected calibration error on the held-out test split. Controlled corruption tests under low light, over-exposure, Gaussian noise, blur, occlusion, and motion blur quantified robustness rather than assuming it. The results show that semantic fusion and calibration improved probability quality on clean data, while HOG-dominant features remained competitive under severe illumination shifts. The explanation module produced deterministic LLM-style safety messages grounded in predicted class, confidence, ontology group, and driving action.
Zitieren
APA
Ye, T., Ma, R., & Luo, S. (2024). Vision-Language Traffic Sign Recognition for Self-Driving: Robust Classification, Uncertainty Calibration, and LLM Safety Explanations on a GTSRB-Compatible Benchmark. Journal of Advanced Computing Systems, 4(10), 84-102. https://doi.org/10.69987/jacs.2024.41007
Vancouver
Ye T, Ma R, Luo S. Vision-Language Traffic Sign Recognition for Self-Driving: Robust Classification, Uncertainty Calibration, and LLM Safety Explanations on a GTSRB-Compatible Benchmark. Journal of Advanced Computing Systems. 2024;4(10):84-102. doi:10.69987/jacs.2024.41007
BibTeX
@article{Ye2024,
author = {Ye, Tong and Ma, Ruiyan and Luo, Sophia},
title = {Vision-Language Traffic Sign Recognition for Self-Driving: Robust Classification, Uncertainty Calibration, and LLM Safety Explanations on a GTSRB-Compatible Benchmark},
journal = {Journal of Advanced Computing Systems},
year = {2024},
volume = {4},
number = {10},
pages = {84--102},
doi = {10.69987/jacs.2024.41007}
}
EUVIMED