EUVIMEDEUVIMED entdecken
Crossref

MS 2 A-Net: Memory-Augmented Spatial–Spectral Attention-Based Deep Unfolding Network for Hyperspectral Image Reconstruction

Xi Chen, Fulin Luo, Chuan Fu, Tan Guo, Weiwen Wu, Jin Xiang, Tingfa Xu, Bo Du

IEEE Transactions on Image Processing · 2026 · 35 · 11798-11811

DOI: 10.1109/tip.2026.3748351 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2026. Verfasst von Xi Chen und 7 weiteren Autor:innen. Die Arbeit nennt 55 Literaturangaben. Gefördert von: National Natural Science Foundation of China, New Cornerstone Science Foundation through the Xplorer Prize, Innovative Research Group Project of Hubei Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Hyperspectral snapshot compressive imaging enables high-resolution spectral acquisition in a single exposure. However, accurate reconstruction from coded measurements remains challenging because of model mismatch, measurement noise, and the need to jointly exploit spatial structure and spectral correlations. Moreover, although recent deep unfolding networks have begun to exploit interstage interactions, many CASSI unfolding architectures still pass only image estimates between stages or employ comparatively heavy feature aggregation, leaving a need for selective and cost-controlled cross-stage refinement. To address these issues, we propose MS2A-Net, a framework that integrates cross-stage memory propagation with linear-complexity spatial-spectral attention to achieve high-fidelity reconstruction. Specifically, we unfold the generalized alternating projection (GAP) algorithm and adopt a learnable compensation branch to refine the GAP-based reconstruction update using the measurement and sensing mask. In the denoising stage, to reduce the computational burden of attention, we design a memory-augmented spatial-spectral attention module (MS2AM). This module couples agent attention with windowed spectral self-attention to model complementary spatial contexts and spectral signatures with linear complexity. Furthermore, a memory-augmented gating unit (MAGU) propagates compact hidden states across unfolding stages, adaptively fuses newly extracted features with stored information, and mitigates stage-wise information loss. Experiments on simulated data demonstrate strong quantitative performance in terms of PSNR and SSIM, while qualitative evaluations on real CASSI measurements show visually coherent structures and reduced artifacts. The code is available at https://github.com/chenx2000/MS2A-Net.

Förderung

  • National Natural Science Foundation of China
  • New Cornerstone Science Foundation through the Xplorer Prize
  • Innovative Research Group Project of Hubei Province
  • New Chongqing Youth Innovative Talents Project

Zitieren

APA

Chen, X., Luo, F., Fu, C., Guo, T., Wu, W., Xiang, J., Xu, T., & Du, B. (2026). MS 2 A-Net: Memory-Augmented Spatial–Spectral Attention-Based Deep Unfolding Network for Hyperspectral Image Reconstruction. IEEE Transactions on Image Processing, 35, 11798-11811. https://doi.org/10.1109/tip.2026.3748351

Vancouver

Chen X, Luo F, Fu C, Guo T, Wu W, Xiang J, et al. MS 2 A-Net: Memory-Augmented Spatial–Spectral Attention-Based Deep Unfolding Network for Hyperspectral Image Reconstruction. IEEE Transactions on Image Processing. 2026;35:11798-11811. doi:10.1109/tip.2026.3748351

BibTeX
@article{Chen2026,
  author = {Chen, Xi and Luo, Fulin and Fu, Chuan and Guo, Tan and Wu, Weiwen and Xiang, Jin and Xu, Tingfa and Du, Bo},
  title = {MS 2 A-Net: Memory-Augmented Spatial–Spectral Attention-Based Deep Unfolding Network for Hyperspectral Image Reconstruction},
  journal = {IEEE Transactions on Image Processing},
  year = {2026},
  volume = {35},
  pages = {11798--11811},
  doi = {10.1109/tip.2026.3748351}
}
Kostenlos starten →