EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Traffic Light Recognition Assistant for Color Vision Deficiency Using YOLO with Multilingual Audio Feedback

Yinyuan Ma iD, Fathan Arifah iD, Qonita Afifah iD, Liko Bun iD, Kangfu Zhang iD, Minan Tang iD

Sensors · 2026

DOI: 10.3390/s26041093 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2026. Verfasst von Yinyuan Ma und 5 weiteren Autor:innen. Beteiligte Einrichtung: School of Mechatronic Engineering, Lanzhou Jiaotong University, Lanzhou 730070, China. Hauptthemen laut MEDLINE: Color Vision Defects, Automobile Driving. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Drivers with color vision deficiency (CVD) often face difficulty recognizing traffic light colors at intersections. Relying solely on their limited color vision can increase safety risks while driving in urban environments. In the era of technological development, Intelligent Transportation Systems (ITSs) increasingly aim to provide support for traffic users, including individuals with CVD. To address user needs from diverse backgrounds, this study aims to develop a traffic light recognition system that provides offline multilingual audio feedback in Indonesian, Mandarin, and English. The proposed approach introduces a spatial-position inference framework by applying a full-frame traffic light annotation strategy to a YOLOv12 model, enabling traffic light state recognition based on the relative position of active lights rather than relying primarily on color information. This work contributes to reducing reliance on color-based perception traffic signal recognition frameworks tailored for assistive ITS applications targeting users with color vision deficiency. System performance is evaluated to verify its feasibility using a comprehensive dataset consisting of various traffic light conditions, including daytime and nighttime scenarios, varying weather, and different traffic densities. Experimental results show an average detection confidence of approximately 0.73, with a maximum confidence of 0.95 and low processing latency of 0.214 s on a CPU-only configuration. The system has the potential to enhance driving safety for individuals with color vision deficiency by offering an additional intelligent assistive tool instead of replacing standard driving regulations.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Color Vision DefectsAutomobile DrivingLightHumansDeep LearningDetection AlgorithmsDatasets as TopicVisual PerceptionColor

Stichwörter der Autor:innen

assistive sensing technologycolor vision deficiencyintelligent transportation systemsspatial-position inferencetraffic light recognition

Autor:innen und Institutionen

  • School of Mechatronic Engineering, Lanzhou Jiaotong University, Lanzhou 730070, China.
  • Fakultas Teknologi Industri, Universitas Ahmad Dahlan (UAD), Yogyakarta 55191, Indonesia.
  • College of International Student Education, Chongqing Medical University, Chongqing 400016, China.
  • School of Automation and Electrical Engineering, Lanzhou Jiaotong University, Lanzhou 730070, China.

ORCID-Profile: Yinyuan Ma, Fathan Arifah, Qonita Afifah, Liko Bun, Kangfu Zhang, Minan Tang

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Ma, Y., Arifah, F., Afifah, Q., Bun, L., Zhang, K., & Tang, M. (2026). Traffic Light Recognition Assistant for Color Vision Deficiency Using YOLO with Multilingual Audio Feedback. Sensors. https://doi.org/10.3390/s26041093

Vancouver

Ma Y, Arifah F, Afifah Q, Bun L, Zhang K, Tang M. Traffic Light Recognition Assistant for Color Vision Deficiency Using YOLO with Multilingual Audio Feedback. Sensors. 2026. doi:10.3390/s26041093

BibTeX
@article{Ma2026,
  author = {Ma, Yinyuan and Arifah, Fathan and Afifah, Qonita and Bun, Liko and Zhang, Kangfu and Tang, Minan},
  title = {Traffic Light Recognition Assistant for Color Vision Deficiency Using YOLO with Multilingual Audio Feedback},
  journal = {Sensors},
  year = {2026},
  doi = {10.3390/s26041093}
}
Kostenlos starten →