Bias behind the Wheel: Fairness Testing of Autonomous Driving Systems
ACM Transactions on Software Engineering and Methodology · 31.03.2025 · 34 (3) · 1-24
DOI: 10.1145/3702989 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Software Engineering and Methodology, online erschienen am 28.02.2025. Verfasst von Xinyue Li und 5 weiteren Autor:innen. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 83 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
This article conducts fairness testing of automated pedestrian detection, a crucial but under-explored issue in autonomous driving systems. We evaluate eight state-of-the-art deep learning-based pedestrian detectors across demographic groups on large-scale real-world datasets. To enable thorough fairness testing, we provide extensive annotations for the datasets, resulting in 8,311 images with 16,070 gender labels, 20,115 age labels, and 3,513 skin tone labels. Our findings reveal significant fairness issues, particularly related to age. The proportion of undetected children is 20.14% higher compared to adults. Furthermore, we explore how various driving scenarios affect the fairness of pedestrian detectors. We find that pedestrian detectors demonstrate significant gender biases during night time, potentially exacerbating the prevalent societal issue of female safety concerns during nighttime out. Moreover, we observe that pedestrian detectors can demonstrate both enhanced fairness and superior performance under specific driving conditions, which challenges the fairness-performance tradeoff theory widely acknowledged in the fairness literature. We publicly release the code, data, and results to support future research on fairness in autonomous driving.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Li, X., Chen, Z., Zhang, J. M., Sarro, F., Zhang, Y., & Liu, X. (2025). Bias behind the Wheel: Fairness Testing of Autonomous Driving Systems. ACM Transactions on Software Engineering and Methodology, 34(3), 1-24. https://doi.org/10.1145/3702989
Vancouver
Li X, Chen Z, Zhang JM, Sarro F, Zhang Y, Liu X. Bias behind the Wheel: Fairness Testing of Autonomous Driving Systems. ACM Transactions on Software Engineering and Methodology. 2025;34(3):1-24. doi:10.1145/3702989
BibTeX
@article{Li2025,
author = {Li, Xinyue and Chen, Zhenpeng and Zhang, Jie M. and Sarro, Federica and Zhang, Ying and Liu, Xuanzhe},
title = {Bias behind the Wheel: Fairness Testing of Autonomous Driving Systems},
journal = {ACM Transactions on Software Engineering and Methodology},
year = {2025},
volume = {34},
number = {3},
pages = {1--24},
doi = {10.1145/3702989}
}
EUVIMED