EUVIMEDEUVIMED entdecken
VergleichsstudieOpen Access · CC BY 4.0

Uncertain about uncertainty in matching‐adjusted indirect comparisons? A simulation study to compare methods for variance estimation

Conor O Chandler iD, Irina Proskorovsky

Research Synthesis Methods · 2024

DOI: 10.1002/jrsm.1759 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift Research Synthesis Methods, 2024. Verfasst von Conor O Chandler und 1 weiteren Autor:innen. Beteiligte Einrichtung: Evidence Synthesis, Modeling & Communication, Evidera, Bethesda, Maryland, USA. Hauptthemen laut MEDLINE: Monte Carlo Method, Computer Simulation, Models, Statistical. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 67 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Thermo Fisher Scientific.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In health technology assessment, matching‐adjusted indirect comparison (MAIC) is the most common method for pairwise comparisons that control for imbalances in baseline characteristics across trials. One of the primary challenges in MAIC is the need to properly account for the additional uncertainty introduced by the matching process. Limited evidence and guidance are available on variance estimation in MAICs. Therefore, we conducted a comprehensive Monte Carlo simulation study to evaluate the performance of different statistical methods across 108 scenarios. Four general approaches for variance estimation were compared in both anchored and unanchored MAICs of binary and time‐to‐event outcomes: (1) conventional estimators (CE) using raw weights; (2) CE using weights rescaled to the effective sample size (ESS); (3) robust sandwich estimators; and (4) bootstrapping. Several variants of sandwich estimators and bootstrap methods were tested. Performance was quantified on the basis of empirical coverage probabilities for 95% confidence intervals and variability ratios. Variability was underestimated by CE + raw weights when population overlap was poor or moderate. Despite several theoretical limitations, CE + ESS weights accurately estimated uncertainty across most scenarios. Original implementations of sandwich estimators had a downward bias in MAICs with a small ESS, and finite sample adjustments led to marked improvements. Bootstrapping was unstable if population overlap was poor and the sample size was limited. All methods produced valid coverage probabilities and standard errors in cases of strong population overlap. Our findings indicate that the sample size, population overlap, and outcome type are important considerations for variance estimation in MAICs.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Monte Carlo MethodComputer SimulationModels, StatisticalUncertaintyHumansSample SizeAlgorithmsTechnology Assessment, BiomedicalBiasData Interpretation, StatisticalResearch DesignReproducibility of ResultsProbabilityConfidence IntervalsAnalysis of Variance

Stichwörter der Autor:innen

bootstrapmatching‐adjusted indirect comparisonrobust sandwich estimatorsimulation studyuncertaintyvariance

Autor:innen und Institutionen

  • Evidence Synthesis, Modeling & Communication, Evidera, Bethesda, Maryland, USA.

ORCID-Profile: Conor O Chandler

Förderung

  • Thermo Fisher Scientific

Zitieren

APA

Chandler, C. O., & Proskorovsky, I. (2024). Uncertain about uncertainty in matching‐adjusted indirect comparisons? A simulation study to compare methods for variance estimation. Research Synthesis Methods. https://doi.org/10.1002/jrsm.1759

Vancouver

Chandler CO, Proskorovsky I. Uncertain about uncertainty in matching‐adjusted indirect comparisons? A simulation study to compare methods for variance estimation. Research Synthesis Methods. 2024. doi:10.1002/jrsm.1759

BibTeX
@article{Chandler2024,
  author = {Chandler, Conor O and Proskorovsky, Irina},
  title = {Uncertain about uncertainty in matching‐adjusted indirect comparisons? A simulation study to compare methods for variance estimation},
  journal = {Research Synthesis Methods},
  year = {2024},
  doi = {10.1002/jrsm.1759}
}
Kostenlos starten →