EUVIMEDEUVIMED entdecken
Crossref

From Natural Language to Executable ETL Flows: The IBM DataStage Assistant

Nitin Gupta, Thomas Gschwind, Shramona Chakraborty, Sameep Mehta, Tristan Tyler, Shreya Sisodia, Ben Clermont

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (47) · 39949-39957

DOI: 10.1609/aaai.v40i47.41429 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Nitin Gupta und 6 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Modern ETL (Extract, Transform, Load) tools offer graphical, no-code interfaces for workflow creation but still require users to manually identify transformation functions and configure their properties, which is time-consuming and demands prior expertise. We present the research and engineering foundations of the IBM DataStage Assistant, a deployed capability that generates complete multi-stage ETL flows directly from natural language (NL) descriptions. Our framework infers transformation functions, their properties, and transformer expressions, enabling novices to discover relevant functions and allowing experts to bypass manual configuration. The proposed framework achieves a prediction accuracy of 96.4% for flow predictions, 87.0% for properties, and 83.6% for transformer expressions. We also show a document exploration module that uses retrieval-augmented generation (RAG) over product documentation to answer tool-specific questions in NL. Implemented in IBM DataStage, this approach supports iterative, in-environment workflow design and reduces context switching. In initial studies, it achieves up to 90% time savings for novices and 50% for experts.

Zitieren

APA

Gupta, N., Gschwind, T., Chakraborty, S., Mehta, S., Tyler, T., Sisodia, S., & Clermont, B. (2026). From Natural Language to Executable ETL Flows: The IBM DataStage Assistant. Proceedings of the AAAI Conference on Artificial Intelligence, 40(47), 39949-39957. https://doi.org/10.1609/aaai.v40i47.41429

Vancouver

Gupta N, Gschwind T, Chakraborty S, Mehta S, Tyler T, Sisodia S, et al. From Natural Language to Executable ETL Flows: The IBM DataStage Assistant. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(47):39949-39957. doi:10.1609/aaai.v40i47.41429

BibTeX
@article{Gupta2026,
  author = {Gupta, Nitin and Gschwind, Thomas and Chakraborty, Shramona and Mehta, Sameep and Tyler, Tristan and Sisodia, Shreya and Clermont, Ben},
  title = {From Natural Language to Executable ETL Flows: The IBM DataStage Assistant},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {47},
  pages = {39949--39957},
  doi = {10.1609/aaai.v40i47.41429}
}
Kostenlos starten →