EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Nighttime Thermal Infrared Image Translation Integrating Visible Images

Shihao Yang, Min Sun, Xiayin Lou, Hanjun Yang, Dong Liu

Remote Sensing · 13.02.2024 · 16 (4) · 666

DOI: 10.3390/rs16040666 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 13.02.2024. Verfasst von Shihao Yang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, High-Performance Computing Platform of Peking University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Nighttime Thermal InfraRed (NTIR) image colorization, also known as the translation of NTIR images into Daytime Color Visible (DCV) images, can facilitate human and intelligent system perception of nighttime scenes under weak lighting conditions. End-to-end neural networks have been used to learn the mapping relationship between temperature and color domains, and translate NTIR images with one channel into DCV images with three channels. However, this mapping relationship is an ill-posed problem with multiple solutions without constraints, resulting in blurred edges, color disorder, and semantic errors. To solve this problem, an NTIR2DCV method that includes two steps is proposed: firstly, fuse Nighttime Color Visible (NCV) images with NTIR images based on an Illumination-Aware, Multilevel Decomposition Latent Low-Rank Representation (IA-MDLatLRR) method, which considers the differences in illumination conditions during image fusion and adjusts the fusion strategy of MDLatLRR accordingly to suppress the adverse effects of nighttime lights; secondly, translate the Nighttime Fused (NF) image to DCV image based on HyperDimensional Computing Generative Adversarial Network (HDC-GAN), which ensures feature-level semantic consistency between the source image (NF image) and the translated image (DCV image) without creating semantic label maps. Extensive comparative experiments and the evaluation metrics values show that the proposed algorithms perform better than other State-Of-The-Art (SOTA) image fusion and translation methods, such as FID and KID, which decreased by 14.1 and 18.9, respectively.

Förderung

  • National Natural Science Foundation of China
  • High-Performance Computing Platform of Peking University

Zitieren

APA

Yang, S., Sun, M., Lou, X., Yang, H., & Liu, D. (2024). Nighttime Thermal Infrared Image Translation Integrating Visible Images. Remote Sensing, 16(4), 666. https://doi.org/10.3390/rs16040666

Vancouver

Yang S, Sun M, Lou X, Yang H, Liu D. Nighttime Thermal Infrared Image Translation Integrating Visible Images. Remote Sensing. 2024;16(4):666. doi:10.3390/rs16040666

BibTeX
@article{Yang2024,
  author = {Yang, Shihao and Sun, Min and Lou, Xiayin and Yang, Hanjun and Liu, Dong},
  title = {Nighttime Thermal Infrared Image Translation Integrating Visible Images},
  journal = {Remote Sensing},
  year = {2024},
  volume = {16},
  number = {4},
  pages = {666},
  doi = {10.3390/rs16040666}
}
Kostenlos starten →