EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Assessment of differentially private synthetic data for utility and fairness in end-to-end machine learning pipelines for tabular data

Mayana Pereira iD, Meghana Kshirsagar, Sumit Mukherjee, Rahul Dodhia iD, Juan Lavista Ferres, Rafael de Sousa

PLOS ONE · 05.02.2024 · 19 (2) · e0297271

DOI: 10.1371/journal.pone.0297271 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS ONE, online erschienen am 05.02.2024. Verfasst von Mayana Pereira und 5 weiteren Autor:innen. Beteiligte Einrichtung: AI for Good Research Lab, Microsoft, Redmond, Washington, United States of America. Hauptthemen laut MEDLINE: Algorithms, Health Facilities. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Differentially private (DP) synthetic datasets are a solution for sharing data while preserving the privacy of individual data providers. Understanding the effects of utilizing DP synthetic data in end-to-end machine learning pipelines impacts areas such as health care and humanitarian action, where data is scarce and regulated by restrictive privacy laws. In this work, we investigate the extent to which synthetic data can replace real, tabular data in machine learning pipelines and identify the most effective synthetic data generation techniques for training and evaluating machine learning models. We systematically investigate the impacts of differentially private synthetic data on downstream classification tasks from the point of view of utility as well as fairness. Our analysis is comprehensive and includes representatives of the two main types of synthetic data generation algorithms: marginal-based and GAN-based. To the best of our knowledge, our work is the first that: (i) proposes a training and evaluation framework that does not assume that real data is available for testing the utility and fairness of machine learning models trained on synthetic data; (ii) presents the most extensive analysis of synthetic dataset generation algorithms in terms of utility and fairness when used for training machine learning models; and (iii) encompasses several different definitions of fairness. Our findings demonstrate that marginal-based synthetic data generators surpass GAN-based ones regarding model training utility for tabular data. Indeed, we show that models trained using data generated by marginal-based algorithms can exhibit similar utility to models trained using real data. Our analysis also reveals that the marginal-based synthetic data generated using AIM and MWEM PGM algorithms can train models that simultaneously achieve utility and fairness characteristics close to those obtained by models trained with real data.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

AlgorithmsHealth FacilitiesInterior Design and FurnishingsKnowledgeMachine Learning

Autor:innen und Institutionen

  • AI for Good Research Lab, Microsoft, Redmond, Washington, United States of America.
  • Department of Electrical Engineering, University of Brasilia, Brasilia, Brazil.
  • INSITRO, San Francisco, CA, United States of America.

ORCID-Profile: Mayana Pereira, Rahul Dodhia

Zitieren

APA

Pereira, M., Kshirsagar, M., Mukherjee, S., Dodhia, R., Lavista Ferres, J., & de Sousa, R. (2024). Assessment of differentially private synthetic data for utility and fairness in end-to-end machine learning pipelines for tabular data. PLOS ONE, 19(2), e0297271. https://doi.org/10.1371/journal.pone.0297271

Vancouver

Pereira M, Kshirsagar M, Mukherjee S, Dodhia R, Lavista Ferres J, de Sousa R. Assessment of differentially private synthetic data for utility and fairness in end-to-end machine learning pipelines for tabular data. PLOS ONE. 2024;19(2):e0297271. doi:10.1371/journal.pone.0297271

BibTeX
@article{Pereira2024,
  author = {Pereira, Mayana and Kshirsagar, Meghana and Mukherjee, Sumit and Dodhia, Rahul and Lavista Ferres, Juan and de Sousa, Rafael},
  title = {Assessment of differentially private synthetic data for utility and fairness in end-to-end machine learning pipelines for tabular data},
  journal = {PLOS ONE},
  year = {2024},
  volume = {19},
  number = {2},
  pages = {e0297271},
  doi = {10.1371/journal.pone.0297271}
}
Kostenlos starten →