Dynamic Occupancy Grid Map with Semantic Information Using Deep Learning-Based BEVFusion Method with Camera and LiDAR Fusion
Sensors · 29.04.2024 · 24 (9) · 2828
DOI: 10.3390/s24092828 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 29.04.2024. Verfasst von Harin Jang und 4 weiteren Autor:innen. Beteiligte Einrichtung: Graduate School of Automotive Engineering, Kookmin University, 77 Jeongneung-ro, Seongbuk-gu, Seoul 02707, Republic of Korea. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 22 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Korea Institute for Advancement of Technology, National Research Foundation of Korea, Ministry of Education, Science and Technology.
Abstract (Originalsprache)
In the field of robotics and autonomous driving, dynamic occupancy grid maps (DOGMs) are typically used to represent the position and velocity information of objects. Although three-dimensional light detection and ranging (LiDAR) sensor-based DOGMs have been actively researched, they have limitations, as they cannot classify types of objects. Therefore, in this study, a deep learning-based camera–LiDAR sensor fusion technique is employed as input to DOGMs. Consequently, not only the position and velocity information of objects but also their class information can be updated, expanding the application areas of DOGMs. Moreover, unclassified LiDAR point measurements contribute to the formation of a map of the surrounding environment, improving the reliability of perception by registering objects that were not classified by deep learning. To achieve this, we developed update rules on the basis of the Dempster–Shafer evidence theory, incorporating class information and the uncertainty of objects occupying grid cells. Furthermore, we analyzed the accuracy of the velocity estimation using two update models. One assigns the occupancy probability only to the edges of the oriented bounding box, whereas the other assigns the occupancy probability to the entire area of the box. The performance of the developed perception technique is evaluated using the public nuScenes dataset. The developed DOGM with object class information will help autonomous vehicles to navigate in complex urban driving environments by providing them with rich information, such as the class and velocity of nearby obstacles.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Graduate School of Automotive Engineering, Kookmin University, 77 Jeongneung-ro, Seongbuk-gu, Seoul 02707, Republic of Korea.
- Department of Mechanical and Mechatronics Engineering, University of Waterloo, 200 University Avenue West, Waterloo, ON N2L 3G1, Canada.
ORCID-Profile: Harin Jang, Taehyun Kim, Soo Jeon, Yeonsik Kang
Förderung
- Korea Institute for Advancement of Technology
- National Research Foundation of Korea
- Ministry of Education, Science and Technology
- Korea Government (MOTIE)
Zitieren
APA
Jang, H., Kim, T., Ahn, K., Jeon, S., & Kang, Y. (2024). Dynamic Occupancy Grid Map with Semantic Information Using Deep Learning-Based BEVFusion Method with Camera and LiDAR Fusion. Sensors, 24(9), 2828. https://doi.org/10.3390/s24092828
Vancouver
Jang H, Kim T, Ahn K, Jeon S, Kang Y. Dynamic Occupancy Grid Map with Semantic Information Using Deep Learning-Based BEVFusion Method with Camera and LiDAR Fusion. Sensors. 2024;24(9):2828. doi:10.3390/s24092828
BibTeX
@article{Jang2024,
author = {Jang, Harin and Kim, Taehyun and Ahn, Kyungjae and Jeon, Soo and Kang, Yeonsik},
title = {Dynamic Occupancy Grid Map with Semantic Information Using Deep Learning-Based BEVFusion Method with Camera and LiDAR Fusion},
journal = {Sensors},
year = {2024},
volume = {24},
number = {9},
pages = {2828},
doi = {10.3390/s24092828}
}
EUVIMED