MS 2 A-Net: Memory-Augmented Spatial–Spectral Attention-Based Deep Unfolding Network for Hyperspectral Image Reconstruction
IEEE Transactions on Image Processing · 2026 · 35 · 11798-11811
DOI: 10.1109/tip.2026.3748351 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2026. Verfasst von Xi Chen und 7 weiteren Autor:innen. Die Arbeit nennt 55 Literaturangaben. Gefördert von: National Natural Science Foundation of China, New Cornerstone Science Foundation through the Xplorer Prize, Innovative Research Group Project of Hubei Province.
Abstract (Originalsprache)
Hyperspectral snapshot compressive imaging enables high-resolution spectral acquisition in a single exposure. However, accurate reconstruction from coded measurements remains challenging because of model mismatch, measurement noise, and the need to jointly exploit spatial structure and spectral correlations. Moreover, although recent deep unfolding networks have begun to exploit interstage interactions, many CASSI unfolding architectures still pass only image estimates between stages or employ comparatively heavy feature aggregation, leaving a need for selective and cost-controlled cross-stage refinement. To address these issues, we propose MS2A-Net, a framework that integrates cross-stage memory propagation with linear-complexity spatial-spectral attention to achieve high-fidelity reconstruction. Specifically, we unfold the generalized alternating projection (GAP) algorithm and adopt a learnable compensation branch to refine the GAP-based reconstruction update using the measurement and sensing mask. In the denoising stage, to reduce the computational burden of attention, we design a memory-augmented spatial-spectral attention module (MS2AM). This module couples agent attention with windowed spectral self-attention to model complementary spatial contexts and spectral signatures with linear complexity. Furthermore, a memory-augmented gating unit (MAGU) propagates compact hidden states across unfolding stages, adaptively fuses newly extracted features with stored information, and mitigates stage-wise information loss. Experiments on simulated data demonstrate strong quantitative performance in terms of PSNR and SSIM, while qualitative evaluations on real CASSI measurements show visually coherent structures and reduced artifacts. The code is available at https://github.com/chenx2000/MS2A-Net.
Förderung
- National Natural Science Foundation of China
- New Cornerstone Science Foundation through the Xplorer Prize
- Innovative Research Group Project of Hubei Province
- New Chongqing Youth Innovative Talents Project
Zitieren
APA
Chen, X., Luo, F., Fu, C., Guo, T., Wu, W., Xiang, J., Xu, T., & Du, B. (2026). MS 2 A-Net: Memory-Augmented Spatial–Spectral Attention-Based Deep Unfolding Network for Hyperspectral Image Reconstruction. IEEE Transactions on Image Processing, 35, 11798-11811. https://doi.org/10.1109/tip.2026.3748351
Vancouver
Chen X, Luo F, Fu C, Guo T, Wu W, Xiang J, et al. MS 2 A-Net: Memory-Augmented Spatial–Spectral Attention-Based Deep Unfolding Network for Hyperspectral Image Reconstruction. IEEE Transactions on Image Processing. 2026;35:11798-11811. doi:10.1109/tip.2026.3748351
BibTeX
@article{Chen2026,
author = {Chen, Xi and Luo, Fulin and Fu, Chuan and Guo, Tan and Wu, Weiwen and Xiang, Jin and Xu, Tingfa and Du, Bo},
title = {MS 2 A-Net: Memory-Augmented Spatial–Spectral Attention-Based Deep Unfolding Network for Hyperspectral Image Reconstruction},
journal = {IEEE Transactions on Image Processing},
year = {2026},
volume = {35},
pages = {11798--11811},
doi = {10.1109/tip.2026.3748351}
}
EUVIMED