Real-World Spectral Compressive Imaging by Learning a Physics-Informed Forward Model
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2026 · 1-18
DOI: 10.1109/tpami.2026.3754492 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2026. Verfasst von Xin Wang und 6 weiteren Autor:innen.
Abstract (Originalsprache)
Coded aperture snapshot spectral imaging (CASSI) enables snapshot acquisition of hyperspectral image (HSI) by compressing a three-dimensional spectral data into a single two-dimensional measurement. While recent learning-based reconstruction methods achieve impressive performance on simulated datasets, their performance often degrades significantly on real CASSI systems, revealing a simulation-to-reality gap. This gap arises from a mismatch between the complex real imaging process and the reconstruction mappings learned from idealized simulated data. To bridge this simulation-to-reality gap, we propose a learnable physics-informed forward model (LPFM) that incorporates the physical structure of CASSI into a learnable proxy network to model the complex real imaging process. To train the LPFM, we construct the first real-world spectral compressive imaging (rSCI) dataset. The rSCI dataset contains 219 pairs of static HSI-CASSI images across diverse indoor and outdoor scenes, as well as additional dynamic CASSI videos. Leveraging rSCI and LPFM, we establish the first real-world benchmark for CASSI reconstruction. Extensive experiments demonstrate that incorporating data generated by LPFM effectively reduces the simulation-to-reality gap and consistently improves reconstruction performance across various state-of-the-art methods.
Zitieren
APA
Wang, X., Wang, L., Ma, X., Wang, Y., Kong, L., Song, W., & Huang, H. (2026). Real-World Spectral Compressive Imaging by Learning a Physics-Informed Forward Model. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1-18. https://doi.org/10.1109/tpami.2026.3754492
Vancouver
Wang X, Wang L, Ma X, Wang Y, Kong L, Song W, et al. Real-World Spectral Compressive Imaging by Learning a Physics-Informed Forward Model. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2026:1-18. doi:10.1109/tpami.2026.3754492
BibTeX
@article{Wang2026,
author = {Wang, Xin and Wang, Lizhi and Ma, Xiangtian and Wang, Yuchen and Kong, Lingqin and Song, Weitao and Huang, Hua},
title = {Real-World Spectral Compressive Imaging by Learning a Physics-Informed Forward Model},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2026},
pages = {1--18},
doi = {10.1109/tpami.2026.3754492}
}
EUVIMED