EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Enhanced Data Augmentation for Infrared Images With Generative Adversarial Networks Aided by Pretrained Models

Yan Wang, Lianbing Deng

IEEE Access · 2024 · 12 · 176739-176750

DOI: 10.1109/access.2024.3491167 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Access, 2024. Verfasst von Yan Wang und 1 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Guangdong High Level Innovation Research Institute, Guangdong Provincial Department of Science and Technology.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Infrared imaging emerges as a promising technique for vision tasks within environments characterized by low or obscured visibility. However, the scarcity of infrared datasets, particularly those comprising paired infrared-visible images, addresses significant challenges for the training of high-performance deep learning models. This paper investigates the application of generative adversarial networks (GANs) for data augmentation in infrared imaging. Our work encompasses a range of GAN models including Pix2Pix, CycleGAN, StyleGAN3, and the proposed Cycle-aided model, which incorporates vision-aided loss to enhance both model training and stability. The results demonstrate that CycleGAN encounters stability issues and is prone to mode collapse, leading to less satisfactory performance. By contrast, the Cycle-aided model that leverages pre-trained models to substantially improve both the discriminative and generative capabilities of GANs, evidenced by a 51% increase in peak signal-to-noise ratio (PSNR), a 43% increase in structural similarity index (SSIM) and an 18% decrease in the Fréchet inception distance (FID) over CycleGAN. These improvements underscore the potential of GANs to improve data augmentation practices for infrared imaging in low-visibility environments. The insights gained also pave the way for future research aimed at developing architectures and training strategies of GANS for fully exploiting the unique properties of data augmentation.

Förderung

  • Guangdong High Level Innovation Research Institute
  • Guangdong Provincial Department of Science and Technology

Zitieren

APA

Wang, Y., & Deng, L. (2024). Enhanced Data Augmentation for Infrared Images With Generative Adversarial Networks Aided by Pretrained Models. IEEE Access, 12, 176739-176750. https://doi.org/10.1109/access.2024.3491167

Vancouver

Wang Y, Deng L. Enhanced Data Augmentation for Infrared Images With Generative Adversarial Networks Aided by Pretrained Models. IEEE Access. 2024;12:176739-176750. doi:10.1109/access.2024.3491167

BibTeX
@article{Wang2024,
  author = {Wang, Yan and Deng, Lianbing},
  title = {Enhanced Data Augmentation for Infrared Images With Generative Adversarial Networks Aided by Pretrained Models},
  journal = {IEEE Access},
  year = {2024},
  volume = {12},
  pages = {176739--176750},
  doi = {10.1109/access.2024.3491167}
}
Kostenlos starten →