Syntheval: a framework for detailed utility and privacy evaluation of tabular synthetic data
Data Mining and Knowledge Discovery · 2025-01 · 39 (1)
DOI: 10.1007/s10618-024-01081-4 ↗Kurz gefasst
Fachartikel in der Zeitschrift Data Mining and Knowledge Discovery, online erschienen am 03.12.2024. Verfasst von Anton D. Lautrup und 3 weiteren Autor:innen. Die Arbeit wurde bisher 55-mal zitiert (Crossref) und nennt 48 Literaturangaben. Gefördert von: Innovationsfonden.
Abstract (Originalsprache)
With the growing demand for synthetic data to address contemporary issues in machine learning, such as data scarcity, data fairness, and data privacy, having robust tools for assessing the utility and potential privacy risks of such data becomes crucial. SynthEval, a novel open-source evaluation framework distinguishes itself from existing tools by treating categorical and numerical attributes with equal care, without assuming any special kind of preprocessing steps. This makes it applicable to virtually any synthetic dataset of tabular records. Our tool leverages statistical and machine learning techniques to comprehensively evaluate synthetic data fidelity and privacy-preserving integrity. SynthEval integrates a wide selection of metrics that can be used independently or in highly customisable benchmark configurations, and can easily be extended with additional metrics. In this paper, we describe SynthEval and illustrate its versatility with examples. The framework facilitates better benchmarking and more consistent comparisons of model capabilities.
Förderung
- Innovationsfonden
Zitieren
APA
Lautrup, A. D., Hyrup, T., Zimek, A., & Schneider-Kamp, P. (2025). Syntheval: a framework for detailed utility and privacy evaluation of tabular synthetic data. Data Mining and Knowledge Discovery, 39(1). https://doi.org/10.1007/s10618-024-01081-4
Vancouver
Lautrup AD, Hyrup T, Zimek A, Schneider-Kamp P. Syntheval: a framework for detailed utility and privacy evaluation of tabular synthetic data. Data Mining and Knowledge Discovery. 2025;39(1). doi:10.1007/s10618-024-01081-4
BibTeX
@article{Lautrup2025,
author = {Lautrup, Anton D. and Hyrup, Tobias and Zimek, Arthur and Schneider-Kamp, Peter},
title = {Syntheval: a framework for detailed utility and privacy evaluation of tabular synthetic data},
journal = {Data Mining and Knowledge Discovery},
year = {2025},
volume = {39},
number = {1},
doi = {10.1007/s10618-024-01081-4}
}
EUVIMED