EUVIMEDEUVIMED entdecken
Systematische ÜbersichtLeitlinie

Critical Challenges and Guidelines in Evaluating Synthetic Tabular Data: A Systematic Review

Nazia Nafis, Iñaki Esnaola, Alvaro Martinez-Perez, Maria‐Cruz Villa‐Uriol, Venet Osmani

White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · 10.04.2025

DOI: 10.48550/arxiv.2504.18544 ↗

Kurz gefasst

Systematische Übersicht in der Zeitschrift White Rose Research Online (University of Leeds, The University of Sheffield, University of York), erschienen am 10.04.2025. Verfasst von Nazia Nafis und 4 weiteren Autor:innen.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Generating synthetic tabular health data is challenging, and evaluating their quality is equally, if not more, complex. This systematic review highlights the critical importance of rigorous evaluation of synthetic health data to ensure reliability, clinical relevance, and appropriate use. From an initial identification of 2067 relevant papers published in the last ten years, 134 studies were selected for detailed analysis. Our review identifies key challenges, including lack of consensus on evaluation methods, inconsistent application of evaluation metrics, limited involvement of domain experts, inadequate reporting of dataset characteristics, and limited reproducibility of results. In response, we provide a structured consolidation of synthetic data generation and evaluation methods into taxonomies, alongside practical guidelines to support more robust and standardised evaluation practices. These findings aim to support the responsible development and use of synthetic health data, aligned with emerging expectations around transparency, reproducibility, and governance, ultimately enabling the community to fully harness its transformative potential and accelerate innovation.

Schlagwörter

synthetic tabular datasynthetic health datasynthetic data evaluationdata quality assessmentevaluation metricsreproducibilitydomain expert involvementreporting guidelinesevaluation guidelinesdata governance

Zitieren

APA

Nafis, N., Esnaola, I., Martinez-Perez, A., Villa‐Uriol, M., & Osmani, V. (2025). Critical Challenges and Guidelines in Evaluating Synthetic Tabular Data: A Systematic Review. White Rose Research Online (University of Leeds, The University of Sheffield, University of York). https://doi.org/10.48550/arxiv.2504.18544

Vancouver

Nafis N, Esnaola I, Martinez-Perez A, Villa‐Uriol M, Osmani V. Critical Challenges and Guidelines in Evaluating Synthetic Tabular Data: A Systematic Review. White Rose Research Online (University of Leeds, The University of Sheffield, University of York). 2025. doi:10.48550/arxiv.2504.18544

BibTeX
@article{Nafis2025,
  author = {Nafis, Nazia and Esnaola, Iñaki and Martinez-Perez, Alvaro and Villa‐Uriol, Maria‐Cruz and Osmani, Venet},
  title = {Critical Challenges and Guidelines in Evaluating Synthetic Tabular Data: A Systematic Review},
  journal = {White Rose Research Online (University of Leeds, The University of Sheffield, University of York)},
  year = {2025},
  doi = {10.48550/arxiv.2504.18544}
}
Kostenlos starten →