EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

RGB‐guided hyperspectral image super‐resolution with deep progressive learning

Tao Zhang, Ying Fu, Liwei Huang, Siyuan Li, Shaodi You, Chenggang Yan

CAAI Transactions on Intelligence Technology · 2024-06 · 9 (3) · 679-694

DOI: 10.1049/cit2.12256 ↗

Kurz gefasst

Fachartikel in der Zeitschrift CAAI Transactions on Intelligence Technology, online erschienen am 17.07.2023. Verfasst von Tao Zhang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 67 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Due to hardware limitations, existing hyperspectral (HS) camera often suffer from low spatial/temporal resolution. Recently, it has been prevalent to super‐resolve a low resolution (LR) HS image into a high resolution (HR) HS image with a HR RGB (or multispectral) image guidance. Previous approaches for this guided super‐resolution task often model the intrinsic characteristic of the desired HR HS image using hand‐crafted priors. Recently, researchers pay more attention to deep learning methods with direct supervised or unsupervised learning, which exploit deep prior only from training dataset or testing data. In this article, an efficient convolutional neural network‐based method is presented to progressively super‐resolve HS image with RGB image guidance. Specifically, a progressive HS image super‐resolution network is proposed, which progressively super‐resolve the LR HS image with pixel shuffled HR RGB image guidance. Then, the super‐resolution network is progressively trained with supervised pre‐training and unsupervised adaption, where supervised pre‐training learns the general prior on training data and unsupervised adaptation generalises the general prior to specific prior for variant testing scenes. The proposed method can effectively exploit prior from training dataset and testing HS and RGB images with spectral‐spatial constraint. It has a good generalisation capability, especially for blind HS image super‐resolution. Comprehensive experimental results show that the proposed deep progressive learning method outperforms the existing state‐of‐the‐art methods for HS image super‐resolution in non‐blind and blind cases.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Zhang, T., Fu, Y., Huang, L., Li, S., You, S., & Yan, C. (2024). RGB‐guided hyperspectral image super‐resolution with deep progressive learning. CAAI Transactions on Intelligence Technology, 9(3), 679-694. https://doi.org/10.1049/cit2.12256

Vancouver

Zhang T, Fu Y, Huang L, Li S, You S, Yan C. RGB‐guided hyperspectral image super‐resolution with deep progressive learning. CAAI Transactions on Intelligence Technology. 2024;9(3):679-694. doi:10.1049/cit2.12256

BibTeX
@article{Zhang2024,
  author = {Zhang, Tao and Fu, Ying and Huang, Liwei and Li, Siyuan and You, Shaodi and Yan, Chenggang},
  title = {RGB‐guided hyperspectral image super‐resolution with deep progressive learning},
  journal = {CAAI Transactions on Intelligence Technology},
  year = {2024},
  volume = {9},
  number = {3},
  pages = {679--694},
  doi = {10.1049/cit2.12256}
}
Kostenlos starten →