Multimodal GenAI for Scalable Synthetic Dataset Generation in Autonomous Vehicles: Advancements, Challenges, and Opportunities in Intelligent Transportation Systems
IEEE Consumer Electronics Magazine · 2026-11 · 15 (6) · 83-98
DOI: 10.1109/mce.2025.3646571 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Consumer Electronics Magazine, 2026-11. Verfasst von Sajid Hussain Ganie und 4 weiteren Autor:innen. Die Arbeit nennt 69 Literaturangaben.
Abstract (Originalsprache)
Generative artificial intelligence (GenAI) is emerging as a transformative tool for synthetic dataset generation in advanced driver-assistance systems (ADASs). Traditional autonomous vehicle (AV) datasets face high collection costs, limited edge-case diversity, and scalability challenges, making alternative data generation approaches essential. This article introduces an innovative application of multimodal GenAI models for AV perception tasks with a focus on ADAS applications. Specifically, the study explores text-to-image, text-to-video, image-to-video, and image-to-image models to generate high-fidelity data for object detection, segmentation, and trajectory prediction. Despite their promise, practical deployment is obstructed by prompt adherence failures, mode collapse, uncontrollability, domain adaptation inconsistencies, and computational inefficiencies. We provide a comparative evaluation of these models, benchmarking their realism, consistency, and adaptability in bridging the synthetic-to-real gap and enhancing AV robustness. Experimental results highlight the strengths and limitations of different approaches, with insights into controllable data synthesis and improvements in real-time efficiency. Furthermore, YOLO models fine-tuned on GenAI-generated datasets achieve superior detection performance, with GAI_YOLOv7 reaching 74.48% mean average precision (mAP) and GAI_YOLOv8x achieving 76.16% mAP, outperforming virtual reality-based models (29.76%, 23.44%).
Zitieren
APA
Ganie, S. H., Ganie, A. A., Chen, Y., Ahmad, B., & Por, L. Y. (2026). Multimodal GenAI for Scalable Synthetic Dataset Generation in Autonomous Vehicles: Advancements, Challenges, and Opportunities in Intelligent Transportation Systems. IEEE Consumer Electronics Magazine, 15(6), 83-98. https://doi.org/10.1109/mce.2025.3646571
Vancouver
Ganie SH, Ganie AA, Chen Y, Ahmad B, Por LY. Multimodal GenAI for Scalable Synthetic Dataset Generation in Autonomous Vehicles: Advancements, Challenges, and Opportunities in Intelligent Transportation Systems. IEEE Consumer Electronics Magazine. 2026;15(6):83-98. doi:10.1109/mce.2025.3646571
BibTeX
@article{Ganie2026,
author = {Ganie, Sajid Hussain and Ganie, Akeel Ali and Chen, Yen-Lin and Ahmad, Belal and Por, Lip Yee},
title = {Multimodal GenAI for Scalable Synthetic Dataset Generation in Autonomous Vehicles: Advancements, Challenges, and Opportunities in Intelligent Transportation Systems},
journal = {IEEE Consumer Electronics Magazine},
year = {2026},
volume = {15},
number = {6},
pages = {83--98},
doi = {10.1109/mce.2025.3646571}
}
EUVIMED