EUVIMEDEUVIMED entdecken
Crossref

Large Language Models for Constructing and Optimizing Machine Learning Workflows: A Survey

Yang Gu, Hengyu You, Jian Cao, Muran Yu, Haoran Fan, Shiyou Qian

ACM Transactions on Software Engineering and Methodology · 30.09.2026 · 35 (9) · 1-46

DOI: 10.1145/3773084 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Software Engineering and Methodology, online erschienen am 21.08.2026. Verfasst von Yang Gu und 5 weiteren Autor:innen. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 215 Literaturangaben. Gefördert von: Interdisciplinary Program of Shanghai Jiao Tong University, Program of Technology Innovation of the Science and Technology Commission of Shanghai Municipality.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Machine Learning (ML) workflows—spanning data preprocessing and feature engineering, model selection and hyperparameter optimization, and workflow evaluation—are increasingly embedded in complex software systems. Building these workflows manually demands substantial ML expertise, domain knowledge, and engineering effort. Automated ML (AutoML) frameworks address parts of this challenge but often suffer from constrained search spaces, limited adaptability, and low interpretability. Recent advances in Large Language Models (LLMs) have opened new opportunities to automate and enhance ML workflows by leveraging their capabilities in language understanding, reasoning, interaction, and code generation, posing new practical and theoretical challenges for Software Engineering (SE). This survey provides the first SE-oriented, stage-wise review of LLM-based ML workflow automation. We introduce a taxonomy covering all three workflow stages, systematically compare and analyze state-of-the-art methods, and synthesize both stage-specific and cross-stage trends. Our analysis yields SE-oriented implications, including the need for robust verification, quality management, context-aware deployment, and risk mitigation, alongside ensuring key quality attributes such as usability, modularity, traceability, and performance. The findings also call for adapting development models, rethinking lifecycle boundaries, and formalizing uncertainty handling to address the probabilistic and collaborative nature of LLM-assisted workflow generation. We further identify major open challenges and outline future research directions to guide the reliable and effective adoption of LLMs in ML workflow development. Our artifacts are publicly available at https://github.com/t-harden/LLM4AutoML .

Förderung

  • Interdisciplinary Program of Shanghai Jiao Tong University
  • Program of Technology Innovation of the Science and Technology Commission of Shanghai Municipality

Zitieren

APA

Gu, Y., You, H., Cao, J., Yu, M., Fan, H., & Qian, S. (2026). Large Language Models for Constructing and Optimizing Machine Learning Workflows: A Survey. ACM Transactions on Software Engineering and Methodology, 35(9), 1-46. https://doi.org/10.1145/3773084

Vancouver

Gu Y, You H, Cao J, Yu M, Fan H, Qian S. Large Language Models for Constructing and Optimizing Machine Learning Workflows: A Survey. ACM Transactions on Software Engineering and Methodology. 2026;35(9):1-46. doi:10.1145/3773084

BibTeX
@article{Gu2026,
  author = {Gu, Yang and You, Hengyu and Cao, Jian and Yu, Muran and Fan, Haoran and Qian, Shiyou},
  title = {Large Language Models for Constructing and Optimizing Machine Learning Workflows: A Survey},
  journal = {ACM Transactions on Software Engineering and Methodology},
  year = {2026},
  volume = {35},
  number = {9},
  pages = {1--46},
  doi = {10.1145/3773084}
}
Kostenlos starten →