Tabular Data Distillation: An Extensive Comparison
Machine Learning and Knowledge Extraction · 24.03.2026 · 8 (4) · 84
DOI: 10.3390/make8040084 ↗Kurz gefasst
Fachartikel in der Zeitschrift Machine Learning and Knowledge Extraction, online erschienen am 24.03.2026. Verfasst von Corneliu Florea und 1 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 77 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Romanian Ministry of Research, Innovation and Digitization, CCDI-UEFISCDI, ELIAC.
Abstract (Originalsprache)
In this paper, we present an extensive evaluation of tabular data distillation methods for downstream classification and regression tasks. Our analysis considers multiple distillation approaches that are problem-type independent (i.e., unsupervised). For downstream learners, we focus on non-neural models such as Random Forest, XGBoost, and Support Vector Machines, as our goal is to evaluate the quality of the distilled data independently of the learner. The evaluation is conducted on 17 classification and nine regression problems. Our findings can be summarized as follows: (1) in all cases, applying a distillation method leads to a decrease in performance compared to the baseline; (2) overall, coreset-based methods are the most effective, with performance losses that are minimal—ranging from around 3% in classification accuracy or regression correlation to, in some cases, being negligible; (3) performance loss is moderately correlated with dataset tailness, measured as the proportion of outliers; (4) all distillation methods alter dataset consistency, narrowing the range of hyperparameter values that yield good performance; and (5) the Coreset Leverage Score remains fast, regardless of the size of the original set and of the distilled set.
Förderung
- Romanian Ministry of Research, Innovation and Digitization, CCDI-UEFISCDI, ELIAC
Zitieren
APA
Florea, C., & Barnoviciu, E. (2026). Tabular Data Distillation: An Extensive Comparison. Machine Learning and Knowledge Extraction, 8(4), 84. https://doi.org/10.3390/make8040084
Vancouver
Florea C, Barnoviciu E. Tabular Data Distillation: An Extensive Comparison. Machine Learning and Knowledge Extraction. 2026;8(4):84. doi:10.3390/make8040084
BibTeX
@article{Florea2026,
author = {Florea, Corneliu and Barnoviciu, Eduard},
title = {Tabular Data Distillation: An Extensive Comparison},
journal = {Machine Learning and Knowledge Extraction},
year = {2026},
volume = {8},
number = {4},
pages = {84},
doi = {10.3390/make8040084}
}
EUVIMED