EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Cross‐Modal Fusion for 3D Point Cloud and 2D Images in Bridge Defect Inspection

Wen Xiong, Xiangteng Ma, Yanjie Zhu, C.S. Cai, Minrong Jiang

Structural Control and Health Monitoring · 2026-01 · 2026 (1)

DOI: 10.1155/stc/8695692 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Structural Control and Health Monitoring, online erschienen am 27.02.2026. Verfasst von Wen Xiong und 4 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, International Science and Technology Cooperation Program of Jiangsu Province, Fundamental Research Funds for the Central Universities.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As the service life of bridges increases, timely and accurate identification of cracks is essential for ensuring structural safety and durability. Traditional inspection methods often rely on 2D images, which lack reliable depth information for assessing the severity and progression of defects. 3D point cloud technology complements traditional 2D vision‐based bridge defect detection by providing depth information for spatial analysis, assessing defect severity and potential extension. Hence, to address the challenges of bridge defect inspection, we propose a scale‐adaptive two‐stage cross‐modal fusion method that integrates 3D point cloud data with 2D images for accurate spatial defect identification. This approach explicitly represents and integrates multisource knowledge, providing a scientifically grounded and reliable solution to bridge defect detection. It supports knowledge‐intensive engineering tasks by combining the advantages of 3D geometric information and 2D semantic cues, enabling better depth quantification and crack assessment. In the first stage, PointNet++ and a registration algorithm is first developed for 3D semantic segmentation and depth quantification of severe cracking defects. In the second stage, a physically consistent 3D–2D–3D cross‐modal fusion method is proposed to detect minor defects missed in previous step, converting point cloud into depth maps and performing semantic segmentation for depth quantification of smaller defects. A cracked concrete beam is used for method evaluation. Results show that the proposed method is robust different defect scales, with PointNet++ attaining a mIoU of 0.91 with depth over 2 cm on crack point cloud and YOLO11 reaching 85% accuracy on 2D depth maps for defects under 2 cm. Extracted crack depths showed a strong fit to the gamma distribution.

Förderung

  • National Natural Science Foundation of China
  • International Science and Technology Cooperation Program of Jiangsu Province
  • Fundamental Research Funds for the Central Universities

Zitieren

APA

Xiong, W., Ma, X., Zhu, Y., Cai, C., & Jiang, M. (2026). Cross‐Modal Fusion for 3D Point Cloud and 2D Images in Bridge Defect Inspection. Structural Control and Health Monitoring, 2026(1). https://doi.org/10.1155/stc/8695692

Vancouver

Xiong W, Ma X, Zhu Y, Cai C, Jiang M. Cross‐Modal Fusion for 3D Point Cloud and 2D Images in Bridge Defect Inspection. Structural Control and Health Monitoring. 2026;2026(1). doi:10.1155/stc/8695692

BibTeX
@article{Xiong2026,
  author = {Xiong, Wen and Ma, Xiangteng and Zhu, Yanjie and Cai, C.S. and Jiang, Minrong},
  title = {Cross‐Modal Fusion for 3D Point Cloud and 2D Images in Bridge Defect Inspection},
  journal = {Structural Control and Health Monitoring},
  year = {2026},
  volume = {2026},
  number = {1},
  doi = {10.1155/stc/8695692}
}
Kostenlos starten →