Zero-Shot Hyperspectral Sharpening
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2023-10 · 45 (10) · 12650-12666
DOI: 10.1109/tpami.2023.3279050 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023-10. Verfasst von Renwei Dian und 2 weiteren Autor:innen. Die Arbeit wurde bisher 147-mal zitiert (Crossref) und nennt 80 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Hunan Natural Science Foundation for Outstanding Young Scholars.
Abstract (Originalsprache)
Fusing hyperspectral images (HSIs) with multispectral images (MSIs) of higher spatial resolution has become an effective way to sharpen HSIs. Recently, deep convolutional neural networks (CNNs) have achieved promising fusion performance. However, these methods often suffer from the lack of training data and limited generalization ability. To address the above problems, we present a zero-shot learning (ZSL) method for HSI sharpening. Specifically, we first propose a novel method to quantitatively estimate the spectral and spatial responses of imaging sensors with high accuracy. In the training procedure, we spatially subsample the MSI and HSI based on the estimated spatial response and use the downsampled HSI and MSI to infer the original HSI. In this way, we can not only exploit the inherent information in the HSI and MSI, but the trained CNN can also be well generalized to the test data. In addition, we take the dimension reduction on the HSI, which reduces the model size and storage usage without sacrificing fusion accuracy. Furthermore, we design an imaging model-based loss function for CNN, which further boosts the fusion performance. The experimental results show the significantly high efficiency and accuracy of our approach.
Förderung
- National Key Research and Development Program of China
- National Natural Science Foundation of China
- Hunan Natural Science Foundation for Outstanding Young Scholars
- CAAI-Huawei MindSpore Open Fund
- Key Laboratory of Visual Perception and Artificial Intelligence Fund of Hunan Province
- Changsha Natural Science Foundation of China
Zitieren
APA
Dian, R., Guo, A., & Li, S. (2023). Zero-Shot Hyperspectral Sharpening. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(10), 12650-12666. https://doi.org/10.1109/tpami.2023.3279050
Vancouver
Dian R, Guo A, Li S. Zero-Shot Hyperspectral Sharpening. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2023;45(10):12650-12666. doi:10.1109/tpami.2023.3279050
BibTeX
@article{Dian2023,
author = {Dian, Renwei and Guo, Anjing and Li, Shutao},
title = {Zero-Shot Hyperspectral Sharpening},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2023},
volume = {45},
number = {10},
pages = {12650--12666},
doi = {10.1109/tpami.2023.3279050}
}
EUVIMED