EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Thangka Hyperspectral Image Super-Resolution Based on a Spatial–Spectral Integration Network

Sai Wang, Fenglei Fan

Remote Sensing · 19.07.2023 · 15 (14) · 3603

DOI: 10.3390/rs15143603 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 19.07.2023. Verfasst von Sai Wang und 1 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Social Science Fund of China, Major Cultivation Fund for Philosophy and Social Sciences of South China Normal University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Thangka refers to a form of Tibetan Buddhist painting on a fabric, scroll, or Thangka, often depicting deities, scenes, or mandalas. Deep-learning-based super-resolution techniques have been applied to improve the spatial resolution of hyperspectral images (HSIs), especially for the preservation and analysis of Thangka cultural heritage. However, existing CNN-based methods encounter difficulties in effectively preserving spatial information, due to challenges such as registration errors and spectral variability. To overcome these limitations, we present a novel cross-sensor super-resolution (SR) framework that utilizes high-resolution RGBs (HR-RGBs) to enhance the spectral features in low-resolution hyperspectral images (LR-HSIs). Our approach utilizes spatial–spectral integration (SSI) blocks and spatial–spectral restoration (SSR) blocks to effectively integrate and reconstruct spatial and spectral features. Furthermore, we introduce a frequency multi-head self-attention (F-MSA) mechanism that treats high-, medium-, and low-frequency features as tokens, enabling self-attention computations across the frequency dimension. We evaluate our method on a custom dataset of ancient Thangka paintings and demonstrate its effectiveness in enhancing the spectral resolution in high-resolution hyperspectral images (HR-HSIs), while preserving the spatial characteristics of Thangka artwork with minimal information loss.

Förderung

  • National Social Science Fund of China
  • Major Cultivation Fund for Philosophy and Social Sciences of South China Normal University

Zitieren

APA

Wang, S., & Fan, F. (2023). Thangka Hyperspectral Image Super-Resolution Based on a Spatial–Spectral Integration Network. Remote Sensing, 15(14), 3603. https://doi.org/10.3390/rs15143603

Vancouver

Wang S, Fan F. Thangka Hyperspectral Image Super-Resolution Based on a Spatial–Spectral Integration Network. Remote Sensing. 2023;15(14):3603. doi:10.3390/rs15143603

BibTeX
@article{Wang2023,
  author = {Wang, Sai and Fan, Fenglei},
  title = {Thangka Hyperspectral Image Super-Resolution Based on a Spatial–Spectral Integration Network},
  journal = {Remote Sensing},
  year = {2023},
  volume = {15},
  number = {14},
  pages = {3603},
  doi = {10.3390/rs15143603}
}
Kostenlos starten →