EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Semantic Fusion Algorithm of 2D LiDAR and Camera Based on Contour and Inverse Projection

Xingyu Yuan iD, Yu Liu iD, Tifan Xiong iD, Wei Zeng iD, Chao Wang iD

Sensors · 17.04.2025 · 25 (8) · 2526

DOI: 10.3390/s25082526 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 17.04.2025. Verfasst von Xingyu Yuan und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Mechanical Science and Engineering, Huazhong University of Science and Technology, 1037 Luoyu Road, Wuhan 430074, China. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Key Research and Development Program of Hubei Province, China, Postdoctoral Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Common single-line 2D LiDAR sensors and cameras have become core components in the field of robotic perception due to their low cost, compact size, and practicality. However, during the data fusion process, the randomness and complexity of real industrial scenes pose challenges. Traditional calibration methods for LiDAR and cameras often rely on precise targets and can accumulate errors, leading to significant limitations. Additionally, the semantic fusion of LiDAR and camera data typically requires extensive projection calculations, complex clustering algorithms, or sophisticated data fusion techniques, resulting in low real-time performance when handling large volumes of data points in dynamic environments. To address these issues, this paper proposes a semantic fusion algorithm for LiDAR and camera data based on contour and inverse projection. The method has two remarkable features: (1) Combined with the ellipse extraction algorithm of the arc support line segment, a LiDAR and camera calibration algorithm based on various regular shapes of an environmental target is proposed, which improves the adaptability of the calibration algorithm to the environment. (2) This paper proposes a semantic segmentation algorithm based on the inverse projection of target contours. It is specifically designed to be versatile and applicable to both linear and arc features, significantly broadening the range of features that can be utilized in various tasks. This flexibility is a key advantage, as it allows the method to adapt to a wider variety of real-world scenarios where both types of features are commonly encountered. Compared with existing LiDAR point cloud semantic segmentation methods, this algorithm eliminates the need for complex clustering algorithms, data fusion techniques, and extensive laser point reprojection calculations. When handling a large number of laser points, the proposed method requires only one or two inverse projections of the contour to filter the range of laser points that intersect with specific targets. This approach enhances both the accuracy of point cloud searches and the speed of semantic processing. Finally, the validity of the semantic fusion algorithm is proven by field experiments.

Schlagwörter

Stichwörter der Autor:innen

2D LiDARcalibrationcamerapoint-line featureprojection matrixsemantic segmentation

Autor:innen und Institutionen

  • School of Mechanical Science and Engineering, Huazhong University of Science and Technology, 1037 Luoyu Road, Wuhan 430074, China.

ORCID-Profile: Xingyu Yuan, Yu Liu, Tifan Xiong, Wei Zeng, Chao Wang

Förderung

  • National Natural Science Foundation of China
  • Key Research and Development Program of Hubei Province, China
  • Postdoctoral Science Foundation of China
  • Key Research and Development Program of Hubei Province

Zitieren

APA

Yuan, X., Liu, Y., Xiong, T., Zeng, W., & Wang, C. (2025). Semantic Fusion Algorithm of 2D LiDAR and Camera Based on Contour and Inverse Projection. Sensors, 25(8), 2526. https://doi.org/10.3390/s25082526

Vancouver

Yuan X, Liu Y, Xiong T, Zeng W, Wang C. Semantic Fusion Algorithm of 2D LiDAR and Camera Based on Contour and Inverse Projection. Sensors. 2025;25(8):2526. doi:10.3390/s25082526

BibTeX
@article{Yuan2025,
  author = {Yuan, Xingyu and Liu, Yu and Xiong, Tifan and Zeng, Wei and Wang, Chao},
  title = {Semantic Fusion Algorithm of 2D LiDAR and Camera Based on Contour and Inverse Projection},
  journal = {Sensors},
  year = {2025},
  volume = {25},
  number = {8},
  pages = {2526},
  doi = {10.3390/s25082526}
}
Kostenlos starten →