Multi-modal Traffic Scenario Generation for Autonomous Driving System Testing
Proceedings of the ACM on Software Engineering · 19.06.2025 · 2 (FSE) · 1733-1756
DOI: 10.1145/3729348 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Software Engineering, online erschienen am 19.06.2025. Verfasst von Zhi Tu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 87 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NSF.
Abstract (Originalsprache)
Autonomous driving systems (ADS) require extensive testing and validation before deployment. However, it is tedious and time-consuming to construct traffic scenarios for ADS testing. In this paper, we propose TrafficComposer, a multi-modal traffic scenario construction approach for ADS testing. TrafficComposer takes as input a natural language (NL) description of a desired traffic scenario and a complementary traffic scene image. Then, it generates the corresponding traffic scenario in a simulator, such as CARLA and LGSVL. Specifically, TrafficComposer integrates high-level dynamic information about the traffic scenario from the NL description and intricate details about the surrounding vehicles, pedestrians, and the road network from the image. The information from the two modalities is complementary to each other and helps generate high-quality traffic scenarios for ADS testing. On a benchmark of 120 traffic scenarios, TrafficComposer achieves 97.0% accuracy, outperforming the best-performing baseline by 7.3%. Both direct testing and fuzz testing experiments on six ADSs prove the bug detection capabilities of the traffic scenarios generated by TrafficComposer. These scenarios can directly discover 37 bugs and help two fuzzing methods find 33%–124% more bugs serving as initial seeds.
Förderung
- NSF
Zitieren
APA
Tu, Z., Niu, L., Fan, W., & Zhang, T. (2025). Multi-modal Traffic Scenario Generation for Autonomous Driving System Testing. Proceedings of the ACM on Software Engineering, 2(FSE), 1733-1756. https://doi.org/10.1145/3729348
Vancouver
Tu Z, Niu L, Fan W, Zhang T. Multi-modal Traffic Scenario Generation for Autonomous Driving System Testing. Proceedings of the ACM on Software Engineering. 2025;2(FSE):1733-1756. doi:10.1145/3729348
BibTeX
@article{Tu2025,
author = {Tu, Zhi and Niu, Liangkun and Fan, Wei and Zhang, Tianyi},
title = {Multi-modal Traffic Scenario Generation for Autonomous Driving System Testing},
journal = {Proceedings of the ACM on Software Engineering},
year = {2025},
volume = {2},
number = {FSE},
pages = {1733--1756},
doi = {10.1145/3729348}
}
EUVIMED