EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Visible-Image-Assisted Nonuniformity Correction of Infrared Images Using the GAN with SEBlock

Xingang Mou, Tailong Zhu, Xiao Zhou iD

Sensors · 20.03.2023 · 23 (6) · 3282

DOI: 10.3390/s23063282 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 20.03.2023. Verfasst von Xingang Mou und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Mechanical and Electronic Engineering, Wuhan University of Technology, Wuhan 430070, China. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, China Scholarship Council.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Aiming at reducing image detail loss and edge blur in the existing nonuniformity correction (NUC) methods, a new visible-image-assisted NUC algorithm based on a dual-discriminator generative adversarial network (GAN) with SEBlock (VIA-NUC) is proposed. The algorithm uses the visible image as a reference for better uniformity. The generative model downsamples the infrared and visible images separately for multiscale feature extraction. Then, image reconstruction is achieved by decoding the infrared feature maps with the assistance of the visible features at the same scale. During decoding, SEBlock, a channel attention mechanism, and skip connection are used to ensure that more distinctive channel and spatial features are extracted from the visible features. Two discriminators based on vision transformer (Vit) and discrete wavelet transform (DWT) were designed, which perform global and local judgments on the generated image from the texture features and frequency domain features of the model, respectively. The results are then fed back to the generator for adversarial learning. This approach can effectively remove nonuniform noise while preserving the texture. The performance of the proposed method was validated using public datasets. The average structural similarity (SSIM) and average peak signal-to-noise ratio (PSNR) of the corrected images exceeded 0.97 and 37.11 dB, respectively. The experimental results show that the proposed method improves the metric evaluation by more than 3%.

Schlagwörter

Stichwörter der Autor:innen

generative adversarial networkinfrared imagenonuniformity correctionvisible imagevision transformer

Autor:innen und Institutionen

  • School of Mechanical and Electronic Engineering, Wuhan University of Technology, Wuhan 430070, China.

ORCID-Profile: Xiao Zhou

Förderung

  • National Natural Science Foundation of China
  • China Scholarship Council

Zitieren

APA

Mou, X., Zhu, T., & Zhou, X. (2023). Visible-Image-Assisted Nonuniformity Correction of Infrared Images Using the GAN with SEBlock. Sensors, 23(6), 3282. https://doi.org/10.3390/s23063282

Vancouver

Mou X, Zhu T, Zhou X. Visible-Image-Assisted Nonuniformity Correction of Infrared Images Using the GAN with SEBlock. Sensors. 2023;23(6):3282. doi:10.3390/s23063282

BibTeX
@article{Mou2023,
  author = {Mou, Xingang and Zhu, Tailong and Zhou, Xiao},
  title = {Visible-Image-Assisted Nonuniformity Correction of Infrared Images Using the GAN with SEBlock},
  journal = {Sensors},
  year = {2023},
  volume = {23},
  number = {6},
  pages = {3282},
  doi = {10.3390/s23063282}
}
Kostenlos starten →