EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

LLM-MetaAS: A Semantic-Statistical Policy Routing Framework for AutoML Execution Strategy Selection

Zhihuan Peng, Pincheng Liu, Yong Li, Tao Zhang, Zhe Zhao, Jun Dong, Ao Chai

Applied Sciences · 13.07.2026 · 16 (14) · 7033

DOI: 10.3390/app16147033 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 13.07.2026. Verfasst von Zhihuan Peng und 6 weiteren Autor:innen. Die Arbeit nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Automated machine learning (AutoML) aims to reduce manual intervention in machine learning pipeline construction. However, AutoML performance is affected not only by the searched pipeline but also by high-level execution policies, such as validation protocols and budget allocation strategies. Auto-sklearn 2.0 has shown that these policies can be selected automatically, but its lightweight task representation mainly captures dataset scale and may not distinguish tasks with similar sizes but different semantic and structural characteristics. To address this limitation, this article proposes LLM-MetaAS, a semantic-statistical framework for AutoML execution policy selection. Building on the established pairwise policy-selection paradigm, LLM-MetaAS focuses on improving task representation rather than introducing pairwise decomposition itself. It constructs a policy-oriented fingerprint by combining LLM-assisted semantic profiling with lightweight statistical descriptors related to validation reliability and computational demand. Policy quality is evaluated using an explicit regret-based criterion relative to the empirical oracle, and vote margins are used to analyze routing uncertainty. Experiments on 39 benchmark tabular classification datasets show that LLM-MetaAS improves overall AutoML performance and selects policies closer to the oracle than fixed strategies, random selection, and the native Auto-sklearn 2.0 selector. Ablation and robustness analyses further support the utility of the complete semantic-statistical representation within the evaluated framework.

Zitieren

APA

Peng, Z., Liu, P., Li, Y., Zhang, T., Zhao, Z., Dong, J., & Chai, A. (2026). LLM-MetaAS: A Semantic-Statistical Policy Routing Framework for AutoML Execution Strategy Selection. Applied Sciences, 16(14), 7033. https://doi.org/10.3390/app16147033

Vancouver

Peng Z, Liu P, Li Y, Zhang T, Zhao Z, Dong J, et al. LLM-MetaAS: A Semantic-Statistical Policy Routing Framework for AutoML Execution Strategy Selection. Applied Sciences. 2026;16(14):7033. doi:10.3390/app16147033

BibTeX
@article{Peng2026,
  author = {Peng, Zhihuan and Liu, Pincheng and Li, Yong and Zhang, Tao and Zhao, Zhe and Dong, Jun and Chai, Ao},
  title = {LLM-MetaAS: A Semantic-Statistical Policy Routing Framework for AutoML Execution Strategy Selection},
  journal = {Applied Sciences},
  year = {2026},
  volume = {16},
  number = {14},
  pages = {7033},
  doi = {10.3390/app16147033}
}
Kostenlos starten →