Pix2Next: Leveraging Vision Foundation Models for RGB to NIR Image Translation
Technologies · 11.04.2025 · 13 (4) · 154
DOI: 10.3390/technologies13040154 ↗Kurz gefasst
Fachartikel in der Zeitschrift Technologies, online erschienen am 11.04.2025. Verfasst von Youngwan Jin und 5 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 62 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Korea Evaluation Institute of Industrial Technology (KEIT).
Abstract (Originalsprache)
This paper proposes Pix2Next, a novel image-to-image translation framework designed to address the challenge of generating high-quality Near-Infrared (NIR) images from RGB inputs. Our method leverages a state-of-the-art Vision Foundation Model (VFM) within an encoder–decoder architecture, incorporating cross-attention mechanisms to enhance feature integration. This design captures detailed global representations and preserves essential spectral characteristics, treating RGB-to-NIR translation as more than a simple domain transfer problem. A multi-scale PatchGAN discriminator ensures realistic image generation at various detail levels, while carefully designed loss functions couple global context understanding with local feature preservation. We performed experiments on the RANUS and IDD-AW datasets to demonstrate Pix2Next’s advantages in quantitative metrics and visual quality, highly improving the FID score compared to existing methods. Furthermore, we demonstrate the practical utility of Pix2Next by showing improved performance on a downstream object detection task using generated NIR data to augment limited real NIR datasets. The proposed method enables the scaling up of NIR datasets without additional data acquisition or annotation efforts, potentially accelerating advancements in NIR-based computer vision applications.
Förderung
- Korea Evaluation Institute of Industrial Technology (KEIT)
Zitieren
APA
Jin, Y., Park, I., Song, H., Ju, H., Nalcakan, Y., & Kim, S. (2025). Pix2Next: Leveraging Vision Foundation Models for RGB to NIR Image Translation. Technologies, 13(4), 154. https://doi.org/10.3390/technologies13040154
Vancouver
Jin Y, Park I, Song H, Ju H, Nalcakan Y, Kim S. Pix2Next: Leveraging Vision Foundation Models for RGB to NIR Image Translation. Technologies. 2025;13(4):154. doi:10.3390/technologies13040154
BibTeX
@article{Jin2025,
author = {Jin, Youngwan and Park, Incheol and Song, Hanbin and Ju, Hyeongjin and Nalcakan, Yagiz and Kim, Shiho},
title = {Pix2Next: Leveraging Vision Foundation Models for RGB to NIR Image Translation},
journal = {Technologies},
year = {2025},
volume = {13},
number = {4},
pages = {154},
doi = {10.3390/technologies13040154}
}
EUVIMED