EUVIMEDEUVIMED entdecken
Crossref

Deep Optical Coding Design in Computational Imaging: A data-driven framework

Henry Arguello, Jorge Bacca, Hasindu Kariyawasam, Edwin Vargas, Miguel Marquez, Ramith Hettiarachchi, Hans Garcia, Kithmini Herath, Udith Haputhanthri, Balpreet Singh Ahluwalia, Peter So, Dushan N. Wadduwage und 1 weitere

IEEE Signal Processing Magazine · 2023-03 · 40 (2) · 75-88

DOI: 10.1109/msp.2022.3200173 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Signal Processing Magazine, 2023-03. Verfasst von Henry Arguello und 12 weiteren Autor:innen. Die Arbeit wurde bisher 46-mal zitiert (Crossref) und nennt 30 Literaturangaben. Gefördert von: National Institutes of Health.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Computational optical imaging (COI) systems leverage optical coding elements (CEs) in their setups to encode a high-dimensional scene in a single or in multiple snapshots and decode it by using computational algorithms. The performance of COI systems highly depends on the design of its main components: the CE pattern and the computational method used to perform a given task. Conventional approaches rely on random patterns or analytical designs to set distribution of the CE. However, the available data and algorithm capabilities of deep neural networks (DNNs) have opened a new horizon in CE data-driven designs that jointly consider the optical and computational decoders. Specifically, by modeling the COI measurements through a fully differentiable image-formation model that considers the physics-based propagation of light and its interaction with the CEs, the parameters that define the CE and the computational decoder can be optimized in an end-to-end (E2E) manner. Moreover, by optimizing just CEs in the same framework, inference tasks can be performed from pure optics. This work surveys the recent advances in CE data-driven design and provides guidelines on how to parameterize different optical elements to include them in the E2E framework. As the E2E framework can handle different inference applications by changing the loss function and the DNN, we present low-level tasks such as spectral imaging reconstruction or high-level tasks such as pose estimation with privacy preservation enhanced by using optimal task-based optical architectures. Finally, we illustrate classification and 3D object-recognition applications performed at the speed of the light using all-optics DNNs.

Förderung

  • National Institutes of Health

Zitieren

APA

Arguello, H., Bacca, J., Kariyawasam, H., Vargas, E., Marquez, M., Hettiarachchi, R., Garcia, H., Herath, K., Haputhanthri, U., Ahluwalia, B. S., So, P., Wadduwage, D. N., & Edussooriya, C. U. (2023). Deep Optical Coding Design in Computational Imaging: A data-driven framework. IEEE Signal Processing Magazine, 40(2), 75-88. https://doi.org/10.1109/msp.2022.3200173

Vancouver

Arguello H, Bacca J, Kariyawasam H, Vargas E, Marquez M, Hettiarachchi R, et al. Deep Optical Coding Design in Computational Imaging: A data-driven framework. IEEE Signal Processing Magazine. 2023;40(2):75-88. doi:10.1109/msp.2022.3200173

BibTeX
@article{Arguello2023,
  author = {Arguello, Henry and Bacca, Jorge and Kariyawasam, Hasindu and Vargas, Edwin and Marquez, Miguel and Hettiarachchi, Ramith and Garcia, Hans and Herath, Kithmini and Haputhanthri, Udith and Ahluwalia, Balpreet Singh and So, Peter and Wadduwage, Dushan N. and Edussooriya, Chamira U.S.},
  title = {Deep Optical Coding Design in Computational Imaging: A data-driven framework},
  journal = {IEEE Signal Processing Magazine},
  year = {2023},
  volume = {40},
  number = {2},
  pages = {75--88},
  doi = {10.1109/msp.2022.3200173}
}
Kostenlos starten →