Non-Serial Quantization-Aware Deep Optics for Snapshot Hyperspectral Imaging
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024-11 · 46 (11) · 6993-7010
DOI: 10.1109/tpami.2024.3425512 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024-11. Verfasst von Lizhi Wang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 73 Literaturangaben. Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Deep optics has been endeavoring to capture hyperspectral images of dynamic scenes, where the optical encoder plays an essential role in deciding the imaging performance. Our key insight is that the optical encoder of a deep optics system is expected to keep fabrication-friendliness and decoder-friendliness, to be faithfully realized in the implementation phase and fully interacted with the decoder in the design phase, respectively. In this paper, we propose the non-serial quantization-aware deep optics (NSQDO), which consists of the fabrication-friendly quantization-aware model (QAM) and the decoder-friendly non-serial manner (NSM). The QAM integrates the quantization process into the optimization and adaptively adjusts the physical height of each quantization level, reducing the deviation of the physical encoder from the numerical simulation through the awareness of and adaptation to the quantization operation of the DOE physical structure. The NSM bridges the encoder and the decoder with full interaction through bidirectional hint connections and flexibilize the connections with a gating mechanism, boosting the power of joint optimization in deep optics. The proposed NSQDO improves the fabrication-friendliness and decoder-friendliness of the encoder and develops the deep optics framework to be more practical and powerful. Extensive synthetic simulation and real hardware experiments demonstrate the superior performance of the proposed method.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Wang, L., Li, L., Song, W., Zhang, L., Xiong, Z., & Huang, H. (2024). Non-Serial Quantization-Aware Deep Optics for Snapshot Hyperspectral Imaging. IEEE Transactions on Pattern Analysis and Machine Intelligence, 46(11), 6993-7010. https://doi.org/10.1109/tpami.2024.3425512
Vancouver
Wang L, Li L, Song W, Zhang L, Xiong Z, Huang H. Non-Serial Quantization-Aware Deep Optics for Snapshot Hyperspectral Imaging. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2024;46(11):6993-7010. doi:10.1109/tpami.2024.3425512
BibTeX
@article{Wang2024,
author = {Wang, Lizhi and Li, Lingen and Song, Weitao and Zhang, Lei and Xiong, Zhiwei and Huang, Hua},
title = {Non-Serial Quantization-Aware Deep Optics for Snapshot Hyperspectral Imaging},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2024},
volume = {46},
number = {11},
pages = {6993--7010},
doi = {10.1109/tpami.2024.3425512}
}
EUVIMED