Toward Automated Deep Learning: Advances and Challenges in Neural Architecture Search
WIREs Data Mining and Knowledge Discovery · 2026-06 · 16 (2)
DOI: 10.1002/widm.70091 ↗At a glance
Journal article in WIREs Data Mining and Knowledge Discovery, published online on 2026-04-29. Written by Jingxia Ren and 2 co-authors. 163 references. Funded by: National Natural Science Foundation of China.
Abstract (original language)
The remarkable success of deep learning across computer vision, natural language processing, and medical diagnosis has largely depended on manually designed neural architectures—a labor‐intensive process lacking transferability. This has motivated the development of automated neural architecture search (NAS). This review systematically examines NAS through four methodological pillars: search space design, architecture optimization, hyperparameter optimization, and performance evaluation. For each pillar, we analyze representative approaches, identify trade‐offs (e.g., efficiency vs. reliability), and synthesize key insights, including the dominance of cell‐based spaces, the emerging trend of hybridization among optimization strategies, and the synergistic gains of multi‐fidelity hyperparameter methods. Beyond these pillars, we discuss quantum NAS as an emerging paradigm and outline seven open challenges, including benchmark expansion, interpretability, human bias, and adversarial robustness. This review provides a comprehensive reference for researchers and practitioners advancing automated deep learning.
Funding
- National Natural Science Foundation of China
Cite
APA
Ren, J., Wan, L., & Xiong, L. (2026). Toward Automated Deep Learning: Advances and Challenges in Neural Architecture Search. WIREs Data Mining and Knowledge Discovery, 16(2). https://doi.org/10.1002/widm.70091
Vancouver
Ren J, Wan L, Xiong L. Toward Automated Deep Learning: Advances and Challenges in Neural Architecture Search. WIREs Data Mining and Knowledge Discovery. 2026;16(2). doi:10.1002/widm.70091
BibTeX
@article{Ren2026,
author = {Ren, Jingxia and Wan, Liang and Xiong, Lan},
title = {Toward Automated Deep Learning: Advances and Challenges in Neural Architecture Search},
journal = {WIREs Data Mining and Knowledge Discovery},
year = {2026},
volume = {16},
number = {2},
doi = {10.1002/widm.70091}
}
EUVIMED