EUVIMEDDescoperă EUVIMED
Open access · CC BY 4.0

Tabular Data Distillation: An Extensive Comparison

Corneliu Florea, Eduard Barnoviciu

Machine Learning and Knowledge Extraction · 2026-03-24 · 8 (4) · 84

DOI: 10.3390/make8040084 ↗

At a glance

Journal article in Machine Learning and Knowledge Extraction, published online on 2026-03-24. Written by Corneliu Florea and 1 co-authors. Cited 1 times so far (Crossref); 77 references. The full text is freely available (open access, CC BY 4.0). Funded by: Romanian Ministry of Research, Innovation and Digitization, CCDI-UEFISCDI, ELIAC.

RezumatDate bibliograficeCiteRelated studies

Abstract (original language)

In this paper, we present an extensive evaluation of tabular data distillation methods for downstream classification and regression tasks. Our analysis considers multiple distillation approaches that are problem-type independent (i.e., unsupervised). For downstream learners, we focus on non-neural models such as Random Forest, XGBoost, and Support Vector Machines, as our goal is to evaluate the quality of the distilled data independently of the learner. The evaluation is conducted on 17 classification and nine regression problems. Our findings can be summarized as follows: (1) in all cases, applying a distillation method leads to a decrease in performance compared to the baseline; (2) overall, coreset-based methods are the most effective, with performance losses that are minimal—ranging from around 3% in classification accuracy or regression correlation to, in some cases, being negligible; (3) performance loss is moderately correlated with dataset tailness, measured as the proportion of outliers; (4) all distillation methods alter dataset consistency, narrowing the range of hyperparameter values that yield good performance; and (5) the Coreset Leverage Score remains fast, regardless of the size of the original set and of the distilled set.

Funding

  • Romanian Ministry of Research, Innovation and Digitization, CCDI-UEFISCDI, ELIAC

Cite

APA

Florea, C., & Barnoviciu, E. (2026). Tabular Data Distillation: An Extensive Comparison. Machine Learning and Knowledge Extraction, 8(4), 84. https://doi.org/10.3390/make8040084

Vancouver

Florea C, Barnoviciu E. Tabular Data Distillation: An Extensive Comparison. Machine Learning and Knowledge Extraction. 2026;8(4):84. doi:10.3390/make8040084

BibTeX
@article{Florea2026,
  author = {Florea, Corneliu and Barnoviciu, Eduard},
  title = {Tabular Data Distillation: An Extensive Comparison},
  journal = {Machine Learning and Knowledge Extraction},
  year = {2026},
  volume = {8},
  number = {4},
  pages = {84},
  doi = {10.3390/make8040084}
}
Start for free →