From Natural Language to Executable ETL Flows: The IBM DataStage Assistant
Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (47) · 39949-39957
DOI: 10.1609/aaai.v40i47.41429 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Nitin Gupta und 6 weiteren Autor:innen.
Abstract (Originalsprache)
Modern ETL (Extract, Transform, Load) tools offer graphical, no-code interfaces for workflow creation but still require users to manually identify transformation functions and configure their properties, which is time-consuming and demands prior expertise. We present the research and engineering foundations of the IBM DataStage Assistant, a deployed capability that generates complete multi-stage ETL flows directly from natural language (NL) descriptions. Our framework infers transformation functions, their properties, and transformer expressions, enabling novices to discover relevant functions and allowing experts to bypass manual configuration. The proposed framework achieves a prediction accuracy of 96.4% for flow predictions, 87.0% for properties, and 83.6% for transformer expressions. We also show a document exploration module that uses retrieval-augmented generation (RAG) over product documentation to answer tool-specific questions in NL. Implemented in IBM DataStage, this approach supports iterative, in-environment workflow design and reduces context switching. In initial studies, it achieves up to 90% time savings for novices and 50% for experts.
Zitieren
APA
Gupta, N., Gschwind, T., Chakraborty, S., Mehta, S., Tyler, T., Sisodia, S., & Clermont, B. (2026). From Natural Language to Executable ETL Flows: The IBM DataStage Assistant. Proceedings of the AAAI Conference on Artificial Intelligence, 40(47), 39949-39957. https://doi.org/10.1609/aaai.v40i47.41429
Vancouver
Gupta N, Gschwind T, Chakraborty S, Mehta S, Tyler T, Sisodia S, et al. From Natural Language to Executable ETL Flows: The IBM DataStage Assistant. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(47):39949-39957. doi:10.1609/aaai.v40i47.41429
BibTeX
@article{Gupta2026,
author = {Gupta, Nitin and Gschwind, Thomas and Chakraborty, Shramona and Mehta, Sameep and Tyler, Tristan and Sisodia, Shreya and Clermont, Ben},
title = {From Natural Language to Executable ETL Flows: The IBM DataStage Assistant},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2026},
volume = {40},
number = {47},
pages = {39949--39957},
doi = {10.1609/aaai.v40i47.41429}
}
EUVIMED