EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Infrared–Visible Multi-Sensor Fusion for UAV Photovoltaic Defect Detection Under Real-World Weak Misalignment

Yuting Wang, Zhengnan Hu, Xubin Peng, Chenhao Sun, Zhiwei Jia

Remote Sensing · 05.08.2026 · 18 (15) · 2607

DOI: 10.3390/rs18152607 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 05.08.2026. Verfasst von Yuting Wang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 58 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Department of Science and Technology of Hunan Province, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

For large-scale photovoltaic plant inspection, UAV-based infrared–visible real-time detection can combine thermal abnormality information with appearance and structural cues. This is useful for improving inspection and maintenance efficiency. However, in real UAV inspection, differences in sensor resolution, field of view, and flight attitude can cause weak misalignment between the two modalities. Since complex image registration is difficult to perform before real-time inference, this misalignment can affect cross-modal feature fusion and defect localization. To address this problem, this paper proposes Frequency-Aware Fusion YOLO (FAF-YOLO) for dual-modal photovoltaic defect detection. We also build a real-scene infrared–visible dual-modal photovoltaic defect dataset, named DM-PV, which covers six defect categories related to thermal anomalies and external environmental interference. FAF-YOLO is based on a dual-branch YOLO detection framework. The C3k2-DPRG module is used to enhance defect boundaries, local details, and neighborhood context. The Frequency-aware Selective Fusion (FSF) module models low-frequency structural information and high-frequency detail responses separately, which reduces edge ghosting and background mis-fusion caused by weak misalignment. A Multi-Scale Differentiated Decoupled Head is then used to handle scale-specific prediction and improve small-defect localization and regional-anomaly discrimination. Experimental results show that FAF-YOLO achieves 92.5% Precision, 86.7% Recall, 91.7% mAP50, and 61.4% mAP50:95 on the DM-PV dataset. It outperforms several mainstream dual-modal detection methods and has lower parameters and computational complexity. Further tests for real-time inspection show that the proposed method keeps more stable performance under weak misalignment perturbations. It also reaches an inference speed of 33 FPS on the Jetson Orin Nano edge platform, which verifies its effectiveness and deployability for UAV-based real-time photovoltaic inspection.

Förderung

  • Department of Science and Technology of Hunan Province
  • National Natural Science Foundation of China

Zitieren

APA

Wang, Y., Hu, Z., Peng, X., Sun, C., & Jia, Z. (2026). Infrared–Visible Multi-Sensor Fusion for UAV Photovoltaic Defect Detection Under Real-World Weak Misalignment. Remote Sensing, 18(15), 2607. https://doi.org/10.3390/rs18152607

Vancouver

Wang Y, Hu Z, Peng X, Sun C, Jia Z. Infrared–Visible Multi-Sensor Fusion for UAV Photovoltaic Defect Detection Under Real-World Weak Misalignment. Remote Sensing. 2026;18(15):2607. doi:10.3390/rs18152607

BibTeX
@article{Wang2026,
  author = {Wang, Yuting and Hu, Zhengnan and Peng, Xubin and Sun, Chenhao and Jia, Zhiwei},
  title = {Infrared–Visible Multi-Sensor Fusion for UAV Photovoltaic Defect Detection Under Real-World Weak Misalignment},
  journal = {Remote Sensing},
  year = {2026},
  volume = {18},
  number = {15},
  pages = {2607},
  doi = {10.3390/rs18152607}
}
Kostenlos starten →