Validation Assessment of Privacy‐Preserving Synthetic Electronic Health Record Data: Comparison of Original Versus Synthetic Data on Real‐World COVID ‐19 Vaccine Effectiveness
Pharmacoepidemiology and Drug Safety · 2024-10 · 33 (10)
DOI: 10.1002/pds.70019 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift Pharmacoepidemiology and Drug Safety, online erschienen am 07.10.2024. Verfasst von Echo Wang und 5 weiteren Autor:innen. Beteiligte Einrichtung: Epidemiology, Merck & Co., Inc., Rahway, New Jersey, USA. Hauptthemen laut MEDLINE: Electronic Health Records, COVID-19, COVID-19 Vaccines. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 24 Literaturangaben. Gefördert von: Merck & Co., Inc., Rahway, NJ, United States, Merck.
Abstract (Originalsprache)
Purpose
To assess the validity of privacy‐preserving synthetic data by comparing results from synthetic versus original EHR data analysis.
Methods
A published retrospective cohort study on real‐world effectiveness of COVID‐19 vaccines by Maccabi Healthcare Services in Israel was replicated using synthetic data generated from the same source, and the results were compared between synthetic versus original datasets. The endpoints included COVID‐19 infection, symptomatic COVID‐19 infection and hospitalization due to infection and were also assessed in several demographic and clinical subgroups. In comparing synthetic versus original data estimates, several metrices were utilized: standardized mean differences (SMD), decision agreement, estimate agreement, confidence interval overlap, and Wald test. Synthetic data were generated five times to assess the stability of results.
Results
The distribution of demographic and clinical characteristics demonstrated very small difference (< 0.01 SMD). In the comparison of vaccine effectiveness assessed in relative risk reduction between synthetic versus original data, there was a 100% decision agreement, 100% estimate agreement, and a high level of confidence interval overlap (88.7%–99.7%) in all five replicates across all subgroups. Similar findings were achieved in the assessment of vaccine effectiveness against symptomatic COVID‐19 Infection. In the comparison of hazard ratios for COVID 19‐related hospitalization and odds ratio for symptomatic COVID‐19 Infection, the Wald tests suggested no significant difference between respective effect estimates in all five replicates for all patient subgroups but there were disagreements in estimate and decision metrices in some subgroups and replicates.
Conclusions
Overall, comparison of synthetic versus original real‐world data demonstrated good validity and reliability. Transparency on the process to generate high fidelity synthetic data and assurances of patient privacy are warranted.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Substanzen
Autor:innen und Institutionen
- Epidemiology, Merck & Co., Inc., Rahway, New Jersey, USA.
- Biostatistics and Research Decision Sciences (BARDS), Merck & Co., Inc., Rahway, New Jersey, USA.
- Kahn Sagol Maccabi (KSM) Research & Innovation Center, Maccabi Healthcare Services, Tel Aviv, Israel.
- Tel Aviv University, Tel Aviv, Israel.
ORCID-Profile: Mehmet Burcu
Förderung
- Merck & Co., Inc., Rahway, NJ, United States
- Merck
Zitieren
APA
Wang, E., Mott, K., Zhang, H., Gazit, S., Chodick, G., & Burcu, M. (2024). Validation Assessment of Privacy‐Preserving Synthetic Electronic Health Record Data: Comparison of Original Versus Synthetic Data on Real‐World COVID ‐19 Vaccine Effectiveness. Pharmacoepidemiology and Drug Safety, 33(10). https://doi.org/10.1002/pds.70019
Vancouver
Wang E, Mott K, Zhang H, Gazit S, Chodick G, Burcu M. Validation Assessment of Privacy‐Preserving Synthetic Electronic Health Record Data: Comparison of Original Versus Synthetic Data on Real‐World COVID ‐19 Vaccine Effectiveness. Pharmacoepidemiology and Drug Safety. 2024;33(10). doi:10.1002/pds.70019
BibTeX
@article{Wang2024,
author = {Wang, Echo and Mott, Katrina and Zhang, Hongtao and Gazit, Sivan and Chodick, Gabriel and Burcu, Mehmet},
title = {Validation Assessment of Privacy‐Preserving Synthetic Electronic Health Record Data: Comparison of Original Versus Synthetic Data on Real‐World COVID ‐19 Vaccine Effectiveness},
journal = {Pharmacoepidemiology and Drug Safety},
year = {2024},
volume = {33},
number = {10},
doi = {10.1002/pds.70019}
}
EUVIMED