EUVIMEDEUVIMED entdecken
VergleichsstudieValidierungsstudie

Validation Assessment of Privacy‐Preserving Synthetic Electronic Health Record Data: Comparison of Original Versus Synthetic Data on Real‐World COVID ‐19 Vaccine Effectiveness

Echo Wang, Katrina Mott, Hongtao Zhang, Sivan Gazit, Gabriel Chodick, Mehmet Burcu iD

Pharmacoepidemiology and Drug Safety · 2024-10 · 33 (10)

DOI: 10.1002/pds.70019 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift Pharmacoepidemiology and Drug Safety, online erschienen am 07.10.2024. Verfasst von Echo Wang und 5 weiteren Autor:innen. Beteiligte Einrichtung: Epidemiology, Merck & Co., Inc., Rahway, New Jersey, USA. Hauptthemen laut MEDLINE: Electronic Health Records, COVID-19, COVID-19 Vaccines. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 24 Literaturangaben. Gefördert von: Merck & Co., Inc., Rahway, NJ, United States, Merck.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

To assess the validity of privacy‐preserving synthetic data by comparing results from synthetic versus original EHR data analysis.

Methods

A published retrospective cohort study on real‐world effectiveness of COVID‐19 vaccines by Maccabi Healthcare Services in Israel was replicated using synthetic data generated from the same source, and the results were compared between synthetic versus original datasets. The endpoints included COVID‐19 infection, symptomatic COVID‐19 infection and hospitalization due to infection and were also assessed in several demographic and clinical subgroups. In comparing synthetic versus original data estimates, several metrices were utilized: standardized mean differences (SMD), decision agreement, estimate agreement, confidence interval overlap, and Wald test. Synthetic data were generated five times to assess the stability of results.

Results

The distribution of demographic and clinical characteristics demonstrated very small difference (< 0.01 SMD). In the comparison of vaccine effectiveness assessed in relative risk reduction between synthetic versus original data, there was a 100% decision agreement, 100% estimate agreement, and a high level of confidence interval overlap (88.7%–99.7%) in all five replicates across all subgroups. Similar findings were achieved in the assessment of vaccine effectiveness against symptomatic COVID‐19 Infection. In the comparison of hazard ratios for COVID 19‐related hospitalization and odds ratio for symptomatic COVID‐19 Infection, the Wald tests suggested no significant difference between respective effect estimates in all five replicates for all patient subgroups but there were disagreements in estimate and decision metrices in some subgroups and replicates.

Conclusions

Overall, comparison of synthetic versus original real‐world data demonstrated good validity and reliability. Transparency on the process to generate high fidelity synthetic data and assurances of patient privacy are warranted.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Electronic Health RecordsCOVID-19COVID-19 VaccinesHumansIsraelRetrospective StudiesMaleFemaleVaccine EfficacyMiddle AgedHospitalizationReproducibility of ResultsAdultAgedPrivacyCohort Studies

Stichwörter der Autor:innen

data accessdata validity/qualitypatient privacyreal‐world datareal‐world evidencereplicabilitysynthetic data

Substanzen

COVID-19 Vaccines

Autor:innen und Institutionen

  • Epidemiology, Merck & Co., Inc., Rahway, New Jersey, USA.
  • Biostatistics and Research Decision Sciences (BARDS), Merck & Co., Inc., Rahway, New Jersey, USA.
  • Kahn Sagol Maccabi (KSM) Research & Innovation Center, Maccabi Healthcare Services, Tel Aviv, Israel.
  • Tel Aviv University, Tel Aviv, Israel.

ORCID-Profile: Mehmet Burcu

Förderung

  • Merck & Co., Inc., Rahway, NJ, United States
  • Merck

Zitieren

APA

Wang, E., Mott, K., Zhang, H., Gazit, S., Chodick, G., & Burcu, M. (2024). Validation Assessment of Privacy‐Preserving Synthetic Electronic Health Record Data: Comparison of Original Versus Synthetic Data on Real‐World COVID ‐19 Vaccine Effectiveness. Pharmacoepidemiology and Drug Safety, 33(10). https://doi.org/10.1002/pds.70019

Vancouver

Wang E, Mott K, Zhang H, Gazit S, Chodick G, Burcu M. Validation Assessment of Privacy‐Preserving Synthetic Electronic Health Record Data: Comparison of Original Versus Synthetic Data on Real‐World COVID ‐19 Vaccine Effectiveness. Pharmacoepidemiology and Drug Safety. 2024;33(10). doi:10.1002/pds.70019

BibTeX
@article{Wang2024,
  author = {Wang, Echo and Mott, Katrina and Zhang, Hongtao and Gazit, Sivan and Chodick, Gabriel and Burcu, Mehmet},
  title = {Validation Assessment of Privacy‐Preserving Synthetic Electronic Health Record Data: Comparison of Original Versus Synthetic Data on Real‐World COVID ‐19 Vaccine Effectiveness},
  journal = {Pharmacoepidemiology and Drug Safety},
  year = {2024},
  volume = {33},
  number = {10},
  doi = {10.1002/pds.70019}
}
Kostenlos starten →