EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Efficiency of machine learning optimizers and meta-optimization for nanophotonic inverse design tasks

Nathaniel Morrison, Eric Y. Ma

APL Machine Learning · 01.03.2025 · 3 (1)

DOI: 10.1063/5.0238444 ↗

Kurz gefasst

Fachartikel in der Zeitschrift APL Machine Learning, online erschienen am 03.01.2025. Verfasst von Nathaniel Morrison und 1 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 68 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The success of deep learning has driven the proliferation and refinement of numerous non-convex optimization algorithms. Despite this growing array of options, the field of nanophotonic inverse design continues to rely heavily on quasi-Newton optimizers such as L-BFGS and basic momentum-based methods such as Adam. A systematic survey of these and other algorithms in the nanophotonics context remains lacking. Here, we compare 24 widely used machine learning optimizers on inverse design tasks. We study two prototypical nanophotonics inverse design problems—the mode splitter and wavelength demultiplexer—across various system sizes, using both hand-tuned and meta-learned hyperparameters. We find that Adam derivatives, as well as the Fromage optimizer, consistently outperform L-BFGS and standard gradient descent, regardless of system size. While meta-learning has a negligible-to-negative impact on Adam and Fromage, it significantly improves others, particularly AdaGrad derivatives and simple gradient descent, such that their performance is on par with Adam. In addition, we observe that the most effective optimizers exhibit the lowest correlation between initial and final performance. Our results and codebase (github.com/Ma-Lab-Cal/photonicsOptComp) provide a valuable framework for selecting and benchmarking optimizers in nanophotonic inverse design.

Zitieren

APA

Morrison, N., & Ma, E. Y. (2025). Efficiency of machine learning optimizers and meta-optimization for nanophotonic inverse design tasks. APL Machine Learning, 3(1). https://doi.org/10.1063/5.0238444

Vancouver

Morrison N, Ma EY. Efficiency of machine learning optimizers and meta-optimization for nanophotonic inverse design tasks. APL Machine Learning. 2025;3(1). doi:10.1063/5.0238444

BibTeX
@article{Morrison2025,
  author = {Morrison, Nathaniel and Ma, Eric Y.},
  title = {Efficiency of machine learning optimizers and meta-optimization for nanophotonic inverse design tasks},
  journal = {APL Machine Learning},
  year = {2025},
  volume = {3},
  number = {1},
  doi = {10.1063/5.0238444}
}
Kostenlos starten →