Traffic Light Recognition Assistant for Color Vision Deficiency Using YOLO with Multilingual Audio Feedback
Sensors · 2026
DOI: 10.3390/s26041093 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, 2026. Verfasst von Yinyuan Ma und 5 weiteren Autor:innen. Beteiligte Einrichtung: School of Mechatronic Engineering, Lanzhou Jiaotong University, Lanzhou 730070, China. Hauptthemen laut MEDLINE: Color Vision Defects, Automobile Driving. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Drivers with color vision deficiency (CVD) often face difficulty recognizing traffic light colors at intersections. Relying solely on their limited color vision can increase safety risks while driving in urban environments. In the era of technological development, Intelligent Transportation Systems (ITSs) increasingly aim to provide support for traffic users, including individuals with CVD. To address user needs from diverse backgrounds, this study aims to develop a traffic light recognition system that provides offline multilingual audio feedback in Indonesian, Mandarin, and English. The proposed approach introduces a spatial-position inference framework by applying a full-frame traffic light annotation strategy to a YOLOv12 model, enabling traffic light state recognition based on the relative position of active lights rather than relying primarily on color information. This work contributes to reducing reliance on color-based perception traffic signal recognition frameworks tailored for assistive ITS applications targeting users with color vision deficiency. System performance is evaluated to verify its feasibility using a comprehensive dataset consisting of various traffic light conditions, including daytime and nighttime scenarios, varying weather, and different traffic densities. Experimental results show an average detection confidence of approximately 0.73, with a maximum confidence of 0.95 and low processing latency of 0.214 s on a CPU-only configuration. The system has the potential to enhance driving safety for individuals with color vision deficiency by offering an additional intelligent assistive tool instead of replacing standard driving regulations.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Mechatronic Engineering, Lanzhou Jiaotong University, Lanzhou 730070, China.
- Fakultas Teknologi Industri, Universitas Ahmad Dahlan (UAD), Yogyakarta 55191, Indonesia.
- College of International Student Education, Chongqing Medical University, Chongqing 400016, China.
- School of Automation and Electrical Engineering, Lanzhou Jiaotong University, Lanzhou 730070, China.
ORCID-Profile: Yinyuan Ma, Fathan Arifah, Qonita Afifah, Liko Bun, Kangfu Zhang, Minan Tang
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Ma, Y., Arifah, F., Afifah, Q., Bun, L., Zhang, K., & Tang, M. (2026). Traffic Light Recognition Assistant for Color Vision Deficiency Using YOLO with Multilingual Audio Feedback. Sensors. https://doi.org/10.3390/s26041093
Vancouver
Ma Y, Arifah F, Afifah Q, Bun L, Zhang K, Tang M. Traffic Light Recognition Assistant for Color Vision Deficiency Using YOLO with Multilingual Audio Feedback. Sensors. 2026. doi:10.3390/s26041093
BibTeX
@article{Ma2026,
author = {Ma, Yinyuan and Arifah, Fathan and Afifah, Qonita and Bun, Liko and Zhang, Kangfu and Tang, Minan},
title = {Traffic Light Recognition Assistant for Color Vision Deficiency Using YOLO with Multilingual Audio Feedback},
journal = {Sensors},
year = {2026},
doi = {10.3390/s26041093}
}
EUVIMED