ParallelEye Pipeline: An Effective Method to Synthesize Images for Improving the Visual Intelligence of Intelligent Vehicles
IEEE Transactions on Systems, Man, and Cybernetics: Systems · 2023-09 · 53 (9) · 5545-5556
DOI: 10.1109/tsmc.2023.3273896 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2023-09. Verfasst von Xuan Li und 4 weiteren Autor:innen. Die Arbeit wurde bisher 47-mal zitiert (Crossref) und nennt 46 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Young Elite Scientists Sponsorship Program of China Association of Science and Technology.
Abstract (Originalsprache)
Virtual simulated scenes are becoming a critical part of autonomous driving. In the context of knowledge automation and machine learning, simulated images are widely used for visual environmental perception. However, even the most inspirational applications have not fully exploited the potential of simulated images in solving real-world problems. In this article, we propose a novel framework “ParallelEye Pipeline,” which uses image-to-image translation and simulated images to automatically generate realistic synthetic images with multiple ground-truth annotations. Specifically, this method has three steps: first, we use Unity3D software to simulate driving scenarios and generate simulated image pairs (including raw images and six ground-truth labels) from the simulated scenes; second, advanced image-to-image translation algorithms can generate realistic and high-resolution synthetic images from simulated image pairs; third, we exploit publicly datasets, simulated images, and synthetic images to conduct experiments for visual perception. The experimental results suggest: 1) synthetic images and simulated images can improve the performance of detectors in real autonomous driving scenarios and 2) image-to-image translation algorithms can be affected by occlusion condition.
Förderung
- National Key Research and Development Program of China
- National Natural Science Foundation of China
- Young Elite Scientists Sponsorship Program of China Association of Science and Technology
- China Postdoctoral Science Foundation
- China Scholarship Council
Zitieren
APA
Li, X., Wang, K., Gu, X., Deng, F., & Wang, F. (2023). ParallelEye Pipeline: An Effective Method to Synthesize Images for Improving the Visual Intelligence of Intelligent Vehicles. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 53(9), 5545-5556. https://doi.org/10.1109/tsmc.2023.3273896
Vancouver
Li X, Wang K, Gu X, Deng F, Wang F. ParallelEye Pipeline: An Effective Method to Synthesize Images for Improving the Visual Intelligence of Intelligent Vehicles. IEEE Transactions on Systems, Man, and Cybernetics: Systems. 2023;53(9):5545-5556. doi:10.1109/tsmc.2023.3273896
BibTeX
@article{Li2023,
author = {Li, Xuan and Wang, Kunfeng and Gu, Xianfeng and Deng, Fang and Wang, Fei-Yue},
title = {ParallelEye Pipeline: An Effective Method to Synthesize Images for Improving the Visual Intelligence of Intelligent Vehicles},
journal = {IEEE Transactions on Systems, Man, and Cybernetics: Systems},
year = {2023},
volume = {53},
number = {9},
pages = {5545--5556},
doi = {10.1109/tsmc.2023.3273896}
}
EUVIMED