EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Concrete Highway Crack Detection Based on Visible Light and Infrared Silicate Spectrum Image Fusion

Jian Xing iD, Ying Liu iD, Guangzhu Zhang

Sensors · 26.04.2024 · 24 (9) · 2759

DOI: 10.3390/s24092759 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 26.04.2024. Verfasst von Jian Xing und 2 weiteren Autor:innen. Beteiligte Einrichtung: College of Computer and Control Engineering, Northeast Forestry University, Harbin 150040, China. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Jian Xing, National Nature Science Foundation of China (NSFC).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Cracks provide the earliest and most immediate visual response to structural deterioration of asphalt pavements. Most of the current methods for crack detection are based on visible light sensors and convolutional neural networks. However, such an approach obviously limits the detection to daytime and good lighting conditions. Therefore, this paper proposes a crack detection technique cross-modal feature alignment of YOLOV5 based on visible and infrared images. The infrared spectrum characteristics of silicate concrete can be an important supplement. The adaptive illumination-aware weight generation module is introduced to compute illumination probability to guide the training of the fusion network. In order to alleviate the problem of weak alignment of the multi-scale feature map, the FA-BIFPN feature pyramid module is proposed. The parallel structure of a dual backbone network takes 40% less time to train than a single backbone network. As determined through validation on FLIR, LLVIP, and VEDAI bimodal datasets, the fused images have more stable performance compared to the visible images. In addition, the detector proposed in this paper surpasses the current advanced YOLOV5 unimodal detector and CFT cross-modal fusion module. In the publicly available bimodal road crack dataset, our method is able to detect cracks of 5 pixels with 98.3% accuracy under weak illumination.

Schlagwörter

Stichwörter der Autor:innen

AMFA-YOLOV5crackscross-modalityfeature alignmentillumination-aware

Autor:innen und Institutionen

  • College of Computer and Control Engineering, Northeast Forestry University, Harbin 150040, China.
  • School of Civil Engineering and Transportation, Northeast Forestry University, Harbin 150040, China.

ORCID-Profile: Jian Xing, Ying Liu

Förderung

  • Jian Xing
  • National Nature Science Foundation of China (NSFC)

Zitieren

APA

Xing, J., Liu, Y., & Zhang, G. (2024). Concrete Highway Crack Detection Based on Visible Light and Infrared Silicate Spectrum Image Fusion. Sensors, 24(9), 2759. https://doi.org/10.3390/s24092759

Vancouver

Xing J, Liu Y, Zhang G. Concrete Highway Crack Detection Based on Visible Light and Infrared Silicate Spectrum Image Fusion. Sensors. 2024;24(9):2759. doi:10.3390/s24092759

BibTeX
@article{Xing2024,
  author = {Xing, Jian and Liu, Ying and Zhang, Guangzhu},
  title = {Concrete Highway Crack Detection Based on Visible Light and Infrared Silicate Spectrum Image Fusion},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {9},
  pages = {2759},
  doi = {10.3390/s24092759}
}
Kostenlos starten →