EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Learned Multi-aperture Color-coded Optics for Snapshot Hyperspectral Imaging

Zheng Shi, Xiong Dun, Haoyu Wei, Siyu Dong, Zhanshan Wang, Xinbin Cheng, Felix Heide, Yifan Peng

ACM Transactions on Graphics · 19.12.2024 · 43 (6) · 1-11

DOI: 10.1145/3687976 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Graphics, online erschienen am 19.11.2024. Verfasst von Zheng Shi und 7 weiteren Autor:innen. Die Arbeit wurde bisher 30-mal zitiert (Crossref) und nennt 58 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities, NSF Career Award.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Learned optics, which incorporate lightweight diffractive optics, coded-aperture modulation, and specialized image-processing neural networks, have recently garnered attention in the field of snapshot hyperspectral imaging (HSI). While conventional methods typically rely on a single lens element paired with an off-the-shelf color sensor, these setups, despite their widespread availability, present inherent limitations. First, the Bayer sensor's spectral response curves are not optimized for HSI applications, limiting spectral fidelity of the reconstruction. Second, single lens designs rely on a single diffractive optical element (DOE) to simultaneously encode spectral information and maintain spatial resolution across all wavelengths, which constrains spectral encoding capabilities. This work investigates a multi-channel lens array combined with aperture-wise color filters, all co-optimized alongside an image reconstruction network. This configuration enables independent spatial encoding and spectral response for each channel, improving optical encoding across both spatial and spectral dimensions. Specifically, we validate that the method achieves over a 5dB improvement in PSNR for spectral reconstruction compared to existing single-diffractive lens and coded-aperture techniques. Experimental validation further confirmed that the method is capable of recovering up to 31 spectral bands within the 429--700 nm range in diverse indoor and outdoor environments.

Förderung

  • National Natural Science Foundation of China
  • Fundamental Research Funds for the Central Universities
  • NSF Career Award
  • Sloan Research Fellowship
  • Research Grants Council of Hong Kong

Zitieren

APA

Shi, Z., Dun, X., Wei, H., Dong, S., Wang, Z., Cheng, X., Heide, F., & Peng, Y. (2024). Learned Multi-aperture Color-coded Optics for Snapshot Hyperspectral Imaging. ACM Transactions on Graphics, 43(6), 1-11. https://doi.org/10.1145/3687976

Vancouver

Shi Z, Dun X, Wei H, Dong S, Wang Z, Cheng X, et al. Learned Multi-aperture Color-coded Optics for Snapshot Hyperspectral Imaging. ACM Transactions on Graphics. 2024;43(6):1-11. doi:10.1145/3687976

BibTeX
@article{Shi2024,
  author = {Shi, Zheng and Dun, Xiong and Wei, Haoyu and Dong, Siyu and Wang, Zhanshan and Cheng, Xinbin and Heide, Felix and Peng, Yifan},
  title = {Learned Multi-aperture Color-coded Optics for Snapshot Hyperspectral Imaging},
  journal = {ACM Transactions on Graphics},
  year = {2024},
  volume = {43},
  number = {6},
  pages = {1--11},
  doi = {10.1145/3687976}
}
Kostenlos starten →