Uncertain about uncertainty in matching‐adjusted indirect comparisons? A simulation study to compare methods for variance estimation
Research Synthesis Methods · 2024
DOI: 10.1002/jrsm.1759 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift Research Synthesis Methods, 2024. Verfasst von Conor O Chandler und 1 weiteren Autor:innen. Beteiligte Einrichtung: Evidence Synthesis, Modeling & Communication, Evidera, Bethesda, Maryland, USA. Hauptthemen laut MEDLINE: Monte Carlo Method, Computer Simulation, Models, Statistical. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 67 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Thermo Fisher Scientific.
Abstract (Originalsprache)
In health technology assessment, matching‐adjusted indirect comparison (MAIC) is the most common method for pairwise comparisons that control for imbalances in baseline characteristics across trials. One of the primary challenges in MAIC is the need to properly account for the additional uncertainty introduced by the matching process. Limited evidence and guidance are available on variance estimation in MAICs. Therefore, we conducted a comprehensive Monte Carlo simulation study to evaluate the performance of different statistical methods across 108 scenarios. Four general approaches for variance estimation were compared in both anchored and unanchored MAICs of binary and time‐to‐event outcomes: (1) conventional estimators (CE) using raw weights; (2) CE using weights rescaled to the effective sample size (ESS); (3) robust sandwich estimators; and (4) bootstrapping. Several variants of sandwich estimators and bootstrap methods were tested. Performance was quantified on the basis of empirical coverage probabilities for 95% confidence intervals and variability ratios. Variability was underestimated by CE + raw weights when population overlap was poor or moderate. Despite several theoretical limitations, CE + ESS weights accurately estimated uncertainty across most scenarios. Original implementations of sandwich estimators had a downward bias in MAICs with a small ESS, and finite sample adjustments led to marked improvements. Bootstrapping was unstable if population overlap was poor and the sample size was limited. All methods produced valid coverage probabilities and standard errors in cases of strong population overlap. Our findings indicate that the sample size, population overlap, and outcome type are important considerations for variance estimation in MAICs.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Evidence Synthesis, Modeling & Communication, Evidera, Bethesda, Maryland, USA.
ORCID-Profile: Conor O Chandler
Förderung
- Thermo Fisher Scientific
Zitieren
APA
Chandler, C. O., & Proskorovsky, I. (2024). Uncertain about uncertainty in matching‐adjusted indirect comparisons? A simulation study to compare methods for variance estimation. Research Synthesis Methods. https://doi.org/10.1002/jrsm.1759
Vancouver
Chandler CO, Proskorovsky I. Uncertain about uncertainty in matching‐adjusted indirect comparisons? A simulation study to compare methods for variance estimation. Research Synthesis Methods. 2024. doi:10.1002/jrsm.1759
BibTeX
@article{Chandler2024,
author = {Chandler, Conor O and Proskorovsky, Irina},
title = {Uncertain about uncertainty in matching‐adjusted indirect comparisons? A simulation study to compare methods for variance estimation},
journal = {Research Synthesis Methods},
year = {2024},
doi = {10.1002/jrsm.1759}
}
EUVIMED