CatDB: Data-Catalog-Guided, LLM-Based Generation of Data-Centric ML Pipelines
Proceedings of the VLDB Endowment · 2025-04 · 18 (8) · 2639-2652
DOI: 10.14778/3742728.3742754 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the VLDB Endowment, online erschienen am 03.09.2025. Verfasst von Saeed Fathollahzadeh und 2 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 85 Literaturangaben.
Abstract (Originalsprache)
Data-centric machine learning (ML) pipelines extend traditional ML pipelines—of feature transformations, hyper-parameter tuning, and model training—by additional pre-processing steps for data cleaning, data augmentation, and feature engineering to create high-quality data with good coverage. Finding effective data-centric ML pipelines is still a labor- and compute-intensive process though. While AutoML tools use effective search strategies, they struggle to scale with large datasets. Large language models (LLMs) show promise for code generation but face challenges in generating data-centric ML pipelines due to private datasets not seen during training, complex pre-processing requirements, and the need for mitigating hallucinations. These demands exceed typical code generation as it requires actions tailored to the characteristics and requirements of a particular dataset. This paper introduces CatDB, a comprehensive, LLM-based system for generating effective, error-free, and efficient data-centric ML pipelines. CatDB leverages data catalog information and refined metadata to dynamically create dataset-specific rules (instructions) to guide the LLM. Moreover, CatDB includes a robust mechanism for automatic validation and error handling of the generated pipeline. Our experimental results show that CatDB reliably generates effective ML pipelines across diverse datasets, achieving accuracy comparable to or better than existing LLM-based systems, standalone AutoML tools, and combined workflows of data cleaning and AutoML tools, while delivering up to orders of magnitude faster performance on large datasets.
Zitieren
APA
Fathollahzadeh, S., Mansour, E., & Boehm, M. (2025). CatDB: Data-Catalog-Guided, LLM-Based Generation of Data-Centric ML Pipelines. Proceedings of the VLDB Endowment, 18(8), 2639-2652. https://doi.org/10.14778/3742728.3742754
Vancouver
Fathollahzadeh S, Mansour E, Boehm M. CatDB: Data-Catalog-Guided, LLM-Based Generation of Data-Centric ML Pipelines. Proceedings of the VLDB Endowment. 2025;18(8):2639-2652. doi:10.14778/3742728.3742754
BibTeX
@article{Fathollahzadeh2025,
author = {Fathollahzadeh, Saeed and Mansour, Essam and Boehm, Matthias},
title = {CatDB: Data-Catalog-Guided, LLM-Based Generation of Data-Centric ML Pipelines},
journal = {Proceedings of the VLDB Endowment},
year = {2025},
volume = {18},
number = {8},
pages = {2639--2652},
doi = {10.14778/3742728.3742754}
}
EUVIMED