A Deep Unfolding Network for Multispectral and Hyperspectral Image Fusion
Remote Sensing · 26.10.2024 · 16 (21) · 3979
DOI: 10.3390/rs16213979 ↗Kurz gefasst
Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 26.10.2024. Verfasst von Bihui Zhang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program of China, China NSFC Projects.
Abstract (Originalsprache)
Multispectral and hyperspectral image fusion (MS/HS fusion) aims to generate a high-resolution hyperspectral (HRHS) image by fusing a high-resolution multispectral (HRMS) and a low-resolution hyperspectral (LRHS) images. The deep unfolding-based MS/HS fusion method is a representative deep learning paradigm due to its excellent performance and sufficient interpretability. However, existing deep unfolding-based MS/HS fusion methods only rely on a fixed linear degradation model, which focuses on modeling the relationships between HRHS and HRMS, as well as HRHS and LRHS. In this paper, we break free from this observation model framework and propose a new observation model. Firstly, the proposed observation model is built based on the convolutional sparse coding (CSC) technique, and then a proximal gradient algorithm is designed to solve this model. Secondly, we unfold the iterative algorithm into a deep network, dubbed as MHF-CSCNet, where the proximal operators are learned using convolutional neural networks. Finally, all trainable parameters can be automatically learned end-to-end from the training pairs. Experimental evaluations conducted on various benchmark datasets demonstrate the superiority of our method both quantitatively and qualitatively compared to other state-of-the-art methods.
Förderung
- National Key Research and Development Program of China
- China NSFC Projects
Zitieren
APA
Zhang, B., Cao, X., & Meng, D. (2024). A Deep Unfolding Network for Multispectral and Hyperspectral Image Fusion. Remote Sensing, 16(21), 3979. https://doi.org/10.3390/rs16213979
Vancouver
Zhang B, Cao X, Meng D. A Deep Unfolding Network for Multispectral and Hyperspectral Image Fusion. Remote Sensing. 2024;16(21):3979. doi:10.3390/rs16213979
BibTeX
@article{Zhang2024,
author = {Zhang, Bihui and Cao, Xiangyong and Meng, Deyu},
title = {A Deep Unfolding Network for Multispectral and Hyperspectral Image Fusion},
journal = {Remote Sensing},
year = {2024},
volume = {16},
number = {21},
pages = {3979},
doi = {10.3390/rs16213979}
}
EUVIMED