EUVIMEDEUVIMED entdecken
Crossref

Efficient on-chip training of large-scale optical neural network through block adjoint training algorithm

Zhiwei Yang, Tian Zhang, Jian Dai, Kun Xu

Optics Express · 16.12.2024 · 32 (26) · 46633

DOI: 10.1364/oe.537813 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Optics Express, online erschienen am 10.12.2024. Verfasst von Zhiwei Yang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 32 Literaturangaben. Gefördert von: Beijing University of Posts and Telecommunications, BUPT Innovation and Entrepreneurship Support Program, State Key Laboratory of Information Photonics and Optical Communications.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

MZI-based block optical neural networks (BONNs), which utilize block matrix multiplication to achieve large-scale network models, have garnered significant attention but still lack efficient training algorithms. In this article, by calculating the original field and adjoint field for the block matrices in BONNs and directly updating the phase values of all phase shifters within the optical mesh, we propose an on-chip block adjoint training (BAT) algorithm for large-scale BONNs. To demonstrate the effectiveness of our proposed algorithm, the trained BONNs are applied in image classification tasks for MNIST and SVHN datasets. The calculated results demonstrate that the performance of the BAT algorithm (95.915% for the MNIST dataset and 82.64% for the SVHN dataset) is competitive with the traditional gradient algorithm based on artificial neural networks (96.238% and 84.182%), but the BONNs can infer 1.5 times and 1.3 times faster than artificial neural networks, respectively. By studying the influence of the block size and the inputted position of the padded zero signals, we demonstrate that the BAT algorithm based on the BONNs with 12 block sizes can achieve higher performance by adding the padded zero signals to the same side beside the normal inputted signals. Additionally, we demonstrate that substituting the complete weight matrices with unitary matrices to construct BONNs is an efficient way to reduce both the system area and the required trainable parameters. Finally, we demonstrate the relatively good robustness of the BAT algorithm and the imprecision alleviation method by using on-chip retraining. Notably, our proposed BAT algorithm shows excellent potential for more complex tasks and network models.

Förderung

  • Beijing University of Posts and Telecommunications
  • BUPT Innovation and Entrepreneurship Support Program
  • State Key Laboratory of Information Photonics and Optical Communications
  • Fundamental Research Funds for the Central Universities
  • National Natural Science Foundation of China

Zitieren

APA

Yang, Z., Zhang, T., Dai, J., & Xu, K. (2024). Efficient on-chip training of large-scale optical neural network through block adjoint training algorithm. Optics Express, 32(26), 46633. https://doi.org/10.1364/oe.537813

Vancouver

Yang Z, Zhang T, Dai J, Xu K. Efficient on-chip training of large-scale optical neural network through block adjoint training algorithm. Optics Express. 2024;32(26):46633. doi:10.1364/oe.537813

BibTeX
@article{Yang2024,
  author = {Yang, Zhiwei and Zhang, Tian and Dai, Jian and Xu, Kun},
  title = {Efficient on-chip training of large-scale optical neural network through block adjoint training algorithm},
  journal = {Optics Express},
  year = {2024},
  volume = {32},
  number = {26},
  pages = {46633},
  doi = {10.1364/oe.537813}
}
Kostenlos starten →