EUVIMEDEUVIMED entdecken
Crossref

Multimodal GenAI for Scalable Synthetic Dataset Generation in Autonomous Vehicles: Advancements, Challenges, and Opportunities in Intelligent Transportation Systems

Sajid Hussain Ganie, Akeel Ali Ganie, Yen-Lin Chen, Belal Ahmad, Lip Yee Por

IEEE Consumer Electronics Magazine · 2026-11 · 15 (6) · 83-98

DOI: 10.1109/mce.2025.3646571 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Consumer Electronics Magazine, 2026-11. Verfasst von Sajid Hussain Ganie und 4 weiteren Autor:innen. Die Arbeit nennt 69 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Generative artificial intelligence (GenAI) is emerging as a transformative tool for synthetic dataset generation in advanced driver-assistance systems (ADASs). Traditional autonomous vehicle (AV) datasets face high collection costs, limited edge-case diversity, and scalability challenges, making alternative data generation approaches essential. This article introduces an innovative application of multimodal GenAI models for AV perception tasks with a focus on ADAS applications. Specifically, the study explores text-to-image, text-to-video, image-to-video, and image-to-image models to generate high-fidelity data for object detection, segmentation, and trajectory prediction. Despite their promise, practical deployment is obstructed by prompt adherence failures, mode collapse, uncontrollability, domain adaptation inconsistencies, and computational inefficiencies. We provide a comparative evaluation of these models, benchmarking their realism, consistency, and adaptability in bridging the synthetic-to-real gap and enhancing AV robustness. Experimental results highlight the strengths and limitations of different approaches, with insights into controllable data synthesis and improvements in real-time efficiency. Furthermore, YOLO models fine-tuned on GenAI-generated datasets achieve superior detection performance, with GAI_YOLOv7 reaching 74.48% mean average precision (mAP) and GAI_YOLOv8x achieving 76.16% mAP, outperforming virtual reality-based models (29.76%, 23.44%).

Zitieren

APA

Ganie, S. H., Ganie, A. A., Chen, Y., Ahmad, B., & Por, L. Y. (2026). Multimodal GenAI for Scalable Synthetic Dataset Generation in Autonomous Vehicles: Advancements, Challenges, and Opportunities in Intelligent Transportation Systems. IEEE Consumer Electronics Magazine, 15(6), 83-98. https://doi.org/10.1109/mce.2025.3646571

Vancouver

Ganie SH, Ganie AA, Chen Y, Ahmad B, Por LY. Multimodal GenAI for Scalable Synthetic Dataset Generation in Autonomous Vehicles: Advancements, Challenges, and Opportunities in Intelligent Transportation Systems. IEEE Consumer Electronics Magazine. 2026;15(6):83-98. doi:10.1109/mce.2025.3646571

BibTeX
@article{Ganie2026,
  author = {Ganie, Sajid Hussain and Ganie, Akeel Ali and Chen, Yen-Lin and Ahmad, Belal and Por, Lip Yee},
  title = {Multimodal GenAI for Scalable Synthetic Dataset Generation in Autonomous Vehicles: Advancements, Challenges, and Opportunities in Intelligent Transportation Systems},
  journal = {IEEE Consumer Electronics Magazine},
  year = {2026},
  volume = {15},
  number = {6},
  pages = {83--98},
  doi = {10.1109/mce.2025.3646571}
}
Kostenlos starten →