EUVIMEDEUVIMED entdecken
Crossref

DiffPrep: Differentiable Data Preprocessing Pipeline Search for Learning over Tabular Data

Peng Li, Zhiyi Chen, Xu Chu, Kexin Rong

Proceedings of the ACM on Management of Data · 13.06.2023 · 1 (2) · 1-26

DOI: 10.1145/3589328 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the ACM on Management of Data, online erschienen am 20.06.2023. Verfasst von Peng Li und 3 weiteren Autor:innen. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 42 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Data preprocessing is a crucial step in the machine learning process that transforms raw data into a more usable format for downstream ML models. However, it can be costly and time-consuming, often requiring the expertise of domain experts. Existing automated machine learning (AutoML) frameworks claim to automate data preprocessing. However, they often use a restricted search space of data preprocessing pipelines which limits the potential performance gains, and they are often too slow as they require training the ML model multiple times. In this paper, we propose DiffPrep, a method that can automatically and efficiently search for a data preprocessing pipeline for a given tabular dataset and a differentiable ML model such that the performance of the ML model is maximized. We formalize the problem of data preprocessing pipeline search as a bi-level optimization problem. To solve this problem efficiently, we transform and relax the discrete, non-differential search space into a continuous and differentiable one, which allows us to perform the pipeline search using gradient descent with training the ML model only once. Our experiments show that DiffPrep achieves the best test accuracy on 15 out of the 18 real-world datasets evaluated and improves the model's test accuracy by up to 6.6 percentage points.

Zitieren

APA

Li, P., Chen, Z., Chu, X., & Rong, K. (2023). DiffPrep: Differentiable Data Preprocessing Pipeline Search for Learning over Tabular Data. Proceedings of the ACM on Management of Data, 1(2), 1-26. https://doi.org/10.1145/3589328

Vancouver

Li P, Chen Z, Chu X, Rong K. DiffPrep: Differentiable Data Preprocessing Pipeline Search for Learning over Tabular Data. Proceedings of the ACM on Management of Data. 2023;1(2):1-26. doi:10.1145/3589328

BibTeX
@article{Li2023,
  author = {Li, Peng and Chen, Zhiyi and Chu, Xu and Rong, Kexin},
  title = {DiffPrep: Differentiable Data Preprocessing Pipeline Search for Learning over Tabular Data},
  journal = {Proceedings of the ACM on Management of Data},
  year = {2023},
  volume = {1},
  number = {2},
  pages = {1--26},
  doi = {10.1145/3589328}
}
Kostenlos starten →