EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Augmented Millimeter Wave Radar and Vision Fusion Simulator for Roadside Perception

Haodong Liu, Jian Wan, Peng Zhou, Shanshan Ding, Wei Huang

Electronics · 11.07.2024 · 13 (14) · 2729

DOI: 10.3390/electronics13142729 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 11.07.2024. Verfasst von Haodong Liu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Distinguished Young Scholar Project, Key Project of the National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Millimeter-wave radar has the advantages of strong penetration, high-precision speed detection and low power consumption. It can be used to conduct robust object detection in abnormal lighting and severe weather conditions. The emerging 4D millimeter-wave radar has improved the quality and quantity of generated point clouds. Adding radar–camera fusion enhances the tracking reliability of transportation system operation. However, it is challenging due to the absence of standardized testing methods. Hence, this paper proposes a radar–camera fusion algorithm testing framework in a highway roadside scenario using SUMO and CARLA simulators. First, we propose a 4D millimeter-wave radar simulation method. A roadside multi-sensor perception dataset is generated in a 3D environment through co-simulation. Then, deep-learning object detection models are trained under different weather and lighting conditions. Finally, we propose a baseline fusion method for the algorithm testing framework. This framework provides a realistic virtual environment for device selection, algorithm testing and parameter tuning for millimeter-wave radar–camera fusion algorithms. Solutions show that the method proposed in this paper can provide a realistic virtual environment for radar–camera fusion algorithm testing for roadside traffic perception. Compared to the camera-only tracking method, the radar–vision fusion method proposed significantly improves tracking performance in rainy night scenarios. The trajectory RMSE is improved by 68.61% in expressway scenarios and 67.45% in urban scenarios. This method can also be applied to improve the detection of stop-and-go waves on congested expressways.

Förderung

  • Distinguished Young Scholar Project
  • Key Project of the National Natural Science Foundation of China

Zitieren

APA

Liu, H., Wan, J., Zhou, P., Ding, S., & Huang, W. (2024). Augmented Millimeter Wave Radar and Vision Fusion Simulator for Roadside Perception. Electronics, 13(14), 2729. https://doi.org/10.3390/electronics13142729

Vancouver

Liu H, Wan J, Zhou P, Ding S, Huang W. Augmented Millimeter Wave Radar and Vision Fusion Simulator for Roadside Perception. Electronics. 2024;13(14):2729. doi:10.3390/electronics13142729

BibTeX
@article{Liu2024,
  author = {Liu, Haodong and Wan, Jian and Zhou, Peng and Ding, Shanshan and Huang, Wei},
  title = {Augmented Millimeter Wave Radar and Vision Fusion Simulator for Roadside Perception},
  journal = {Electronics},
  year = {2024},
  volume = {13},
  number = {14},
  pages = {2729},
  doi = {10.3390/electronics13142729}
}
Kostenlos starten →