Sophisticated deep learning with on-chip optical diffractive tensor processing
Photonics Research · 01.06.2023 · 11 (6) · 1125
DOI: 10.1364/prj.484662 ↗Kurz gefasst
Fachartikel in der Zeitschrift Photonics Research, online erschienen am 01.06.2023. Verfasst von Yuyao Huang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 40-mal zitiert (Crossref) und nennt 111 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Beijing Municipal Science and Technology Commission.
Abstract (Originalsprache)
Ever-growing deep-learning technologies are making revolutionary changes for modern life. However, conventional computing architectures are designed to process sequential and digital programs but are burdened with performing massive parallel and adaptive deep-learning applications. Photonic integrated circuits provide an efficient approach to mitigate bandwidth limitations and the power-wall brought on by its electronic counterparts, showing great potential in ultrafast and energy-free high-performance computation. Here, we propose an optical computing architecture enabled by on-chip diffraction to implement convolutional acceleration, termed “optical convolution unit” (OCU). We demonstrate that any real-valued convolution kernels can be exploited by the OCU with a prominent computational throughput boosting via the concept of structral reparameterization. With the OCU as the fundamental unit, we build an optical convolutional neural network (oCNN) to implement two popular deep learning tasks: classification and regression. For classification, Fashion Modified National Institute of Standards and Technology (Fashion-MNIST) and Canadian Institute for Advanced Research (CIFAR-4) data sets are tested with accuracies of 91.63% and 86.25%, respectively. For regression, we build an optical denoising convolutional neural network to handle Gaussian noise in gray-scale images with noise level σ =10, 15, and 20, resulting in clean images with an average peak signal-to-noise ratio (PSNR) of 31.70, 29.39, and 27.72 dB, respectively. The proposed OCU presents remarkable performance of low energy consumption and high information density due to its fully passive nature and compact footprint, providing a parallel while lightweight solution for future compute-in-memory architecture to handle high dimensional tensors in deep learning.
Förderung
- National Natural Science Foundation of China
- Beijing Municipal Science and Technology Commission
Zitieren
APA
Huang, Y., Fu, T., Huang, H., Yang, S., & Chen, H. (2023). Sophisticated deep learning with on-chip optical diffractive tensor processing. Photonics Research, 11(6), 1125. https://doi.org/10.1364/prj.484662
Vancouver
Huang Y, Fu T, Huang H, Yang S, Chen H. Sophisticated deep learning with on-chip optical diffractive tensor processing. Photonics Research. 2023;11(6):1125. doi:10.1364/prj.484662
BibTeX
@article{Huang2023,
author = {Huang, Yuyao and Fu, Tingzhao and Huang, Honghao and Yang, Sigang and Chen, Hongwei},
title = {Sophisticated deep learning with on-chip optical diffractive tensor processing},
journal = {Photonics Research},
year = {2023},
volume = {11},
number = {6},
pages = {1125},
doi = {10.1364/prj.484662}
}
EUVIMED