Mutual learning knowledge distillation framework for adaptive optimization of optical diffractive neural network
APL Photonics · 01.11.2025 · 10 (11)
DOI: 10.1063/5.0288172 ↗Kurz gefasst
Fachartikel in der Zeitschrift APL Photonics, online erschienen am 04.11.2025. Verfasst von Xiaoguang Ma und 5 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Science and Technology Commission of Shanghai Municipality, the Shanghai Municipal Science and Technology Major Project, the Shanghai Frontiers Science Center Program.
Abstract (Originalsprache)
The growing computational demands of artificial intelligence motivate the development of optical neural networks (ONNs), while their practical deployment remains constrained by optimization complexity and limited adaptability. We propose a mutual learning knowledge distillation framework for optical diffractive neural networks (ODNNs), synergizing photonic computing with adaptive training strategies. Our architecture enables bidirectional knowledge transfer between parameter-efficient optical student networks and electrical ResNet teachers, leveraging both labeled data and probabilistic guidance. The validation on Fashion-MNIST and Kuzushiji-MNIST demonstrates classification accuracy improvements of 5.9% and 13.88%, respectively, over conventional ODNNs training. In addition, we further developed the photonic to photonic mutual learning computational paradigm, in which an optical network with 0.98 × 106 parameters can bootstrap compact photonic classifiers with 0.19 × 106 parameters, achieving an accuracy of 79.5% on MNIST and yielding an absolute improvement of 9% relative to the noncooperative baseline. Even though the all-optical mutual learning paradigm still has a gap of about 19% with the state-of-the-art ODNNs, the number of parameters of the guided student networks is smaller than the state-of-the-art networks by several or even dozens of times. These results establish a paradigm for overcoming fundamental limitations in ONN optimization, paving the way for a new era in which ONNs can solve large-scale practical problems through photonic–electronic and photonic–photonic co-design.
Förderung
- Science and Technology Commission of Shanghai Municipality
- the Shanghai Municipal Science and Technology Major Project
- the Shanghai Frontiers Science Center Program
- National Key Research and Development Program of China
- National Natural Science Foundation of China
- the Shanghai Science and Technology Innovation Action of Plan
Zitieren
APA
Ma, X., Xia, W., Qiu, Z., Hu, F., Gu, M., & Zhang, Q. (2025). Mutual learning knowledge distillation framework for adaptive optimization of optical diffractive neural network. APL Photonics, 10(11). https://doi.org/10.1063/5.0288172
Vancouver
Ma X, Xia W, Qiu Z, Hu F, Gu M, Zhang Q. Mutual learning knowledge distillation framework for adaptive optimization of optical diffractive neural network. APL Photonics. 2025;10(11). doi:10.1063/5.0288172
BibTeX
@article{Ma2025,
author = {Ma, Xiaoguang and Xia, Wan and Qiu, Zhecheng and Hu, Fangzhen and Gu, Min and Zhang, Qiming},
title = {Mutual learning knowledge distillation framework for adaptive optimization of optical diffractive neural network},
journal = {APL Photonics},
year = {2025},
volume = {10},
number = {11},
doi = {10.1063/5.0288172}
}
EUVIMED