Improving Synthetic Data Generation Through Federated Learning in Scarce and Heterogeneous Data Scenarios
Big Data and Cognitive Computing · 21.01.2025 · 9 (2) · 18
DOI: 10.3390/bdcc9020018 ↗Kurz gefasst
Fachartikel in der Zeitschrift Big Data and Cognitive Computing, online erschienen am 21.01.2025. Verfasst von Patricia A. Apellániz und 2 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: GenoMed4All and SYNTHEMA projects from the European Union’s Horizon 2020 Research and Innovation Program.
Abstract (Originalsprache)
Synthetic Data Generation (SDG) is a promising solution for healthcare, offering the potential to generate synthetic patient data closely resembling real-world data while preserving privacy. However, data scarcity and heterogeneity, particularly in under-resourced regions, challenge the effective implementation of SDG. This paper addresses these challenges using Federated Learning (FL) for SDG, focusing on sharing synthetic patients across nodes. By leveraging collective knowledge and diverse data distributions, we hypothesize that sharing synthetic data can significantly enhance the quality and representativeness of generated data, particularly for institutions with limited or biased datasets. This approach aligns with meta-learning concepts, like Domain Randomized Search. We compare two FL techniques, FedAvg and Synthetic Data Sharing (SDS), the latter being our proposed contribution. Both approaches are evaluated using variational autoencoders with Bayesian Gaussian mixture models across diverse medical datasets. Our results demonstrate that while both methods improve SDG, SDS consistently outperforms FedAvg, producing higher-quality, more representative synthetic data. Non-IID scenarios reveal that while FedAvg achieves improvements of 13–27% in reducing divergence compared to isolated training, SDS achieves reductions exceeding 50% in the worst-performing nodes. These findings underscore synthetic data sharing potential to reduce disparities between data-rich and data-poor institutions, fostering more equitable healthcare research and innovation.
Förderung
- GenoMed4All and SYNTHEMA projects from the European Union’s Horizon 2020 Research and Innovation Program
Zitieren
APA
Apellániz, P. A., Parras, J., & Zazo, S. (2025). Improving Synthetic Data Generation Through Federated Learning in Scarce and Heterogeneous Data Scenarios. Big Data and Cognitive Computing, 9(2), 18. https://doi.org/10.3390/bdcc9020018
Vancouver
Apellániz PA, Parras J, Zazo S. Improving Synthetic Data Generation Through Federated Learning in Scarce and Heterogeneous Data Scenarios. Big Data and Cognitive Computing. 2025;9(2):18. doi:10.3390/bdcc9020018
BibTeX
@article{Apellniz2025,
author = {Apellániz, Patricia A. and Parras, Juan and Zazo, Santiago},
title = {Improving Synthetic Data Generation Through Federated Learning in Scarce and Heterogeneous Data Scenarios},
journal = {Big Data and Cognitive Computing},
year = {2025},
volume = {9},
number = {2},
pages = {18},
doi = {10.3390/bdcc9020018}
}
EUVIMED