Learned Multi-aperture Color-coded Optics for Snapshot Hyperspectral Imaging
ACM Transactions on Graphics · 19.12.2024 · 43 (6) · 1-11
DOI: 10.1145/3687976 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Graphics, online erschienen am 19.11.2024. Verfasst von Zheng Shi und 7 weiteren Autor:innen. Die Arbeit wurde bisher 30-mal zitiert (Crossref) und nennt 58 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities, NSF Career Award.
Abstract (Originalsprache)
Learned optics, which incorporate lightweight diffractive optics, coded-aperture modulation, and specialized image-processing neural networks, have recently garnered attention in the field of snapshot hyperspectral imaging (HSI). While conventional methods typically rely on a single lens element paired with an off-the-shelf color sensor, these setups, despite their widespread availability, present inherent limitations. First, the Bayer sensor's spectral response curves are not optimized for HSI applications, limiting spectral fidelity of the reconstruction. Second, single lens designs rely on a single diffractive optical element (DOE) to simultaneously encode spectral information and maintain spatial resolution across all wavelengths, which constrains spectral encoding capabilities. This work investigates a multi-channel lens array combined with aperture-wise color filters, all co-optimized alongside an image reconstruction network. This configuration enables independent spatial encoding and spectral response for each channel, improving optical encoding across both spatial and spectral dimensions. Specifically, we validate that the method achieves over a 5dB improvement in PSNR for spectral reconstruction compared to existing single-diffractive lens and coded-aperture techniques. Experimental validation further confirmed that the method is capable of recovering up to 31 spectral bands within the 429--700 nm range in diverse indoor and outdoor environments.
Förderung
- National Natural Science Foundation of China
- Fundamental Research Funds for the Central Universities
- NSF Career Award
- Sloan Research Fellowship
- Research Grants Council of Hong Kong
Zitieren
APA
Shi, Z., Dun, X., Wei, H., Dong, S., Wang, Z., Cheng, X., Heide, F., & Peng, Y. (2024). Learned Multi-aperture Color-coded Optics for Snapshot Hyperspectral Imaging. ACM Transactions on Graphics, 43(6), 1-11. https://doi.org/10.1145/3687976
Vancouver
Shi Z, Dun X, Wei H, Dong S, Wang Z, Cheng X, et al. Learned Multi-aperture Color-coded Optics for Snapshot Hyperspectral Imaging. ACM Transactions on Graphics. 2024;43(6):1-11. doi:10.1145/3687976
BibTeX
@article{Shi2024,
author = {Shi, Zheng and Dun, Xiong and Wei, Haoyu and Dong, Siyu and Wang, Zhanshan and Cheng, Xinbin and Heide, Felix and Peng, Yifan},
title = {Learned Multi-aperture Color-coded Optics for Snapshot Hyperspectral Imaging},
journal = {ACM Transactions on Graphics},
year = {2024},
volume = {43},
number = {6},
pages = {1--11},
doi = {10.1145/3687976}
}
EUVIMED