LLMENAS: Evolutionary Neural Architecture Search via Large Language Model Guidance
IEEE Transactions on Evolutionary Computation · 2026-08 · 30 (4) · 1362-1376
DOI: 10.1109/tevc.2026.3670336 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Evolutionary Computation, 2026-08. Verfasst von Yutao Lai und 4 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 90 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Guangdong Province.
Abstract (Originalsprache)
Differentiable neural architecture search (NAS) and traditional evolutionary approaches frequently struggle with premature convergence to local optima. To overcome this limitation, we propose LLMENAS, a hierarchical framework that introduces trajectory-aware fitness design as the upper-level optimizer. By analyzing the convergence state of historical optimization trajectories, the large language model (LLM) acts as a fitness designer to dynamically design fitness functions. This mechanism enables the search to navigate complex landscapes and escape local optima. Furthermore, we introduce a closed-loop self-improving mechanism, enabling the LLM to iteratively enhance its design strategies through self-reflection and self-refinement based on feedback. Extensive experiments show that LLMENAS achieves competitive results, with top-1 accuracies of 97.58% on CIFAR-10, 83.52% on CIFAR-100, and 75.6% on ImageNet-1k. Furthermore, it is achieved with remarkable efficiency, costing only 0.15 GPU days on the CIFAR 10 datasets and 2 GPU days on ImageNet. The source code is publicly available at: https://github.com/LLMENAS/LLMENAS
Förderung
- National Natural Science Foundation of China
- Natural Science Foundation of Guangdong Province
Zitieren
APA
Lai, Y., Cai, Z., Chen, L., Ling, T., & Liu, H. (2026). LLMENAS: Evolutionary Neural Architecture Search via Large Language Model Guidance. IEEE Transactions on Evolutionary Computation, 30(4), 1362-1376. https://doi.org/10.1109/tevc.2026.3670336
Vancouver
Lai Y, Cai Z, Chen L, Ling T, Liu H. LLMENAS: Evolutionary Neural Architecture Search via Large Language Model Guidance. IEEE Transactions on Evolutionary Computation. 2026;30(4):1362-1376. doi:10.1109/tevc.2026.3670336
BibTeX
@article{Lai2026,
author = {Lai, Yutao and Cai, Zicheng and Chen, Lei and Ling, Tongtao and Liu, Hai-Lin},
title = {LLMENAS: Evolutionary Neural Architecture Search via Large Language Model Guidance},
journal = {IEEE Transactions on Evolutionary Computation},
year = {2026},
volume = {30},
number = {4},
pages = {1362--1376},
doi = {10.1109/tevc.2026.3670336}
}
EUVIMED