EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

DDSR: Degradation-Aware Diffusion Model for Spectral Reconstruction from RGB Images

Yunlai Chen, Xiaoyan Zhang

Remote Sensing · 23.07.2024 · 16 (15) · 2692

DOI: 10.3390/rs16152692 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 23.07.2024. Verfasst von Yunlai Chen und 1 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The reconstruction of hyperspectral images (HSIs) from RGB images is an attractive low-cost approach to recover hyperspectral information. However, existing approaches focus on learning an end-to-end mapping of RGB images and their corresponding HSIs with neural networks, which makes it difficult to ensure generalization due to the fact that they are trained on data with a specific degradation process. As a new paradigm of generative models, the diffusion model has shown great potential in image restoration, especially in noisy contexts. To address the unstable generalization ability of end-to-end models while exploiting the powerful ability of the diffusion model, we propose a degradation-aware diffusion model. The degradation process from HSI to RGB is modeled as a combination of multiple degradation operators, which are used to guide the inverse process of the diffusion model by utilizing a degradation-aware correction. By integrating the degradation-aware correction to the diffusion model, we obtain an efficient solver for spectral reconstruction, which is robust to different degradation patterns. Experiment results on various public datasets demonstrate that our method achieves competitive performance and shows a promising generalization ability.

Zitieren

APA

Chen, Y., & Zhang, X. (2024). DDSR: Degradation-Aware Diffusion Model for Spectral Reconstruction from RGB Images. Remote Sensing, 16(15), 2692. https://doi.org/10.3390/rs16152692

Vancouver

Chen Y, Zhang X. DDSR: Degradation-Aware Diffusion Model for Spectral Reconstruction from RGB Images. Remote Sensing. 2024;16(15):2692. doi:10.3390/rs16152692

BibTeX
@article{Chen2024,
  author = {Chen, Yunlai and Zhang, Xiaoyan},
  title = {DDSR: Degradation-Aware Diffusion Model for Spectral Reconstruction from RGB Images},
  journal = {Remote Sensing},
  year = {2024},
  volume = {16},
  number = {15},
  pages = {2692},
  doi = {10.3390/rs16152692}
}
Kostenlos starten →