Visible-Image-Assisted Nonuniformity Correction of Infrared Images Using the GAN with SEBlock
Sensors · 20.03.2023 · 23 (6) · 3282
DOI: 10.3390/s23063282 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 20.03.2023. Verfasst von Xingang Mou und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Mechanical and Electronic Engineering, Wuhan University of Technology, Wuhan 430070, China. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, China Scholarship Council.
Abstract (Originalsprache)
Aiming at reducing image detail loss and edge blur in the existing nonuniformity correction (NUC) methods, a new visible-image-assisted NUC algorithm based on a dual-discriminator generative adversarial network (GAN) with SEBlock (VIA-NUC) is proposed. The algorithm uses the visible image as a reference for better uniformity. The generative model downsamples the infrared and visible images separately for multiscale feature extraction. Then, image reconstruction is achieved by decoding the infrared feature maps with the assistance of the visible features at the same scale. During decoding, SEBlock, a channel attention mechanism, and skip connection are used to ensure that more distinctive channel and spatial features are extracted from the visible features. Two discriminators based on vision transformer (Vit) and discrete wavelet transform (DWT) were designed, which perform global and local judgments on the generated image from the texture features and frequency domain features of the model, respectively. The results are then fed back to the generator for adversarial learning. This approach can effectively remove nonuniform noise while preserving the texture. The performance of the proposed method was validated using public datasets. The average structural similarity (SSIM) and average peak signal-to-noise ratio (PSNR) of the corrected images exceeded 0.97 and 37.11 dB, respectively. The experimental results show that the proposed method improves the metric evaluation by more than 3%.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Mechanical and Electronic Engineering, Wuhan University of Technology, Wuhan 430070, China.
ORCID-Profile: Xiao Zhou
Förderung
- National Natural Science Foundation of China
- China Scholarship Council
Zitieren
APA
Mou, X., Zhu, T., & Zhou, X. (2023). Visible-Image-Assisted Nonuniformity Correction of Infrared Images Using the GAN with SEBlock. Sensors, 23(6), 3282. https://doi.org/10.3390/s23063282
Vancouver
Mou X, Zhu T, Zhou X. Visible-Image-Assisted Nonuniformity Correction of Infrared Images Using the GAN with SEBlock. Sensors. 2023;23(6):3282. doi:10.3390/s23063282
BibTeX
@article{Mou2023,
author = {Mou, Xingang and Zhu, Tailong and Zhou, Xiao},
title = {Visible-Image-Assisted Nonuniformity Correction of Infrared Images Using the GAN with SEBlock},
journal = {Sensors},
year = {2023},
volume = {23},
number = {6},
pages = {3282},
doi = {10.3390/s23063282}
}
EUVIMED