EUVIMEDEUVIMED entdecken
Crossref

Zero-Shot Hyperspectral Sharpening

Renwei Dian, Anjing Guo, Shutao Li

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2023-10 · 45 (10) · 12650-12666

DOI: 10.1109/tpami.2023.3279050 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023-10. Verfasst von Renwei Dian und 2 weiteren Autor:innen. Die Arbeit wurde bisher 147-mal zitiert (Crossref) und nennt 80 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Hunan Natural Science Foundation for Outstanding Young Scholars.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Fusing hyperspectral images (HSIs) with multispectral images (MSIs) of higher spatial resolution has become an effective way to sharpen HSIs. Recently, deep convolutional neural networks (CNNs) have achieved promising fusion performance. However, these methods often suffer from the lack of training data and limited generalization ability. To address the above problems, we present a zero-shot learning (ZSL) method for HSI sharpening. Specifically, we first propose a novel method to quantitatively estimate the spectral and spatial responses of imaging sensors with high accuracy. In the training procedure, we spatially subsample the MSI and HSI based on the estimated spatial response and use the downsampled HSI and MSI to infer the original HSI. In this way, we can not only exploit the inherent information in the HSI and MSI, but the trained CNN can also be well generalized to the test data. In addition, we take the dimension reduction on the HSI, which reduces the model size and storage usage without sacrificing fusion accuracy. Furthermore, we design an imaging model-based loss function for CNN, which further boosts the fusion performance. The experimental results show the significantly high efficiency and accuracy of our approach.

Förderung

  • National Key Research and Development Program of China
  • National Natural Science Foundation of China
  • Hunan Natural Science Foundation for Outstanding Young Scholars
  • CAAI-Huawei MindSpore Open Fund
  • Key Laboratory of Visual Perception and Artificial Intelligence Fund of Hunan Province
  • Changsha Natural Science Foundation of China

Zitieren

APA

Dian, R., Guo, A., & Li, S. (2023). Zero-Shot Hyperspectral Sharpening. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(10), 12650-12666. https://doi.org/10.1109/tpami.2023.3279050

Vancouver

Dian R, Guo A, Li S. Zero-Shot Hyperspectral Sharpening. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2023;45(10):12650-12666. doi:10.1109/tpami.2023.3279050

BibTeX
@article{Dian2023,
  author = {Dian, Renwei and Guo, Anjing and Li, Shutao},
  title = {Zero-Shot Hyperspectral Sharpening},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2023},
  volume = {45},
  number = {10},
  pages = {12650--12666},
  doi = {10.1109/tpami.2023.3279050}
}
Kostenlos starten →