Thangka Hyperspectral Image Super-Resolution Based on a Spatial–Spectral Integration Network
Remote Sensing · 19.07.2023 · 15 (14) · 3603
DOI: 10.3390/rs15143603 ↗Kurz gefasst
Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 19.07.2023. Verfasst von Sai Wang und 1 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Social Science Fund of China, Major Cultivation Fund for Philosophy and Social Sciences of South China Normal University.
Abstract (Originalsprache)
Thangka refers to a form of Tibetan Buddhist painting on a fabric, scroll, or Thangka, often depicting deities, scenes, or mandalas. Deep-learning-based super-resolution techniques have been applied to improve the spatial resolution of hyperspectral images (HSIs), especially for the preservation and analysis of Thangka cultural heritage. However, existing CNN-based methods encounter difficulties in effectively preserving spatial information, due to challenges such as registration errors and spectral variability. To overcome these limitations, we present a novel cross-sensor super-resolution (SR) framework that utilizes high-resolution RGBs (HR-RGBs) to enhance the spectral features in low-resolution hyperspectral images (LR-HSIs). Our approach utilizes spatial–spectral integration (SSI) blocks and spatial–spectral restoration (SSR) blocks to effectively integrate and reconstruct spatial and spectral features. Furthermore, we introduce a frequency multi-head self-attention (F-MSA) mechanism that treats high-, medium-, and low-frequency features as tokens, enabling self-attention computations across the frequency dimension. We evaluate our method on a custom dataset of ancient Thangka paintings and demonstrate its effectiveness in enhancing the spectral resolution in high-resolution hyperspectral images (HR-HSIs), while preserving the spatial characteristics of Thangka artwork with minimal information loss.
Förderung
- National Social Science Fund of China
- Major Cultivation Fund for Philosophy and Social Sciences of South China Normal University
Zitieren
APA
Wang, S., & Fan, F. (2023). Thangka Hyperspectral Image Super-Resolution Based on a Spatial–Spectral Integration Network. Remote Sensing, 15(14), 3603. https://doi.org/10.3390/rs15143603
Vancouver
Wang S, Fan F. Thangka Hyperspectral Image Super-Resolution Based on a Spatial–Spectral Integration Network. Remote Sensing. 2023;15(14):3603. doi:10.3390/rs15143603
BibTeX
@article{Wang2023,
author = {Wang, Sai and Fan, Fenglei},
title = {Thangka Hyperspectral Image Super-Resolution Based on a Spatial–Spectral Integration Network},
journal = {Remote Sensing},
year = {2023},
volume = {15},
number = {14},
pages = {3603},
doi = {10.3390/rs15143603}
}
EUVIMED