EUVIMEDDescubrir EUVIMED
Open access · CC BY-NC 4.0

Precision of Treatment Hierarchy: A Metric for Quantifying Certainty in Treatment Hierarchies From Network Meta‐Analysis

Augustine Wigle, Audrey Béliveau iD, Georgia Salanti, Gerta Rücker iD, Guido Schwarzer, Dimitris Mavridis, Adriani Nikolakopoulou

Statistics in Medicine · 2025-06 · 44 (13-14)

DOI: 10.1002/sim.70176 ↗

At a glance

Journal article in Statistics in Medicine, published online on 2025-06-21. Written by Augustine Wigle and 6 co-authors. Institution: Department of Statistics and Actuarial Science, University of Waterloo, Ontario, Canada. Major MEDLINE topics: Network Meta-Analysis as Topic. Cited 5 times so far (Crossref); 19 references. The full text is freely available (open access, CC BY-NC 4.0). Funded by: Hellenic Foundation for Research and Innovation, Deutsche Forschungsgemeinschaft, Natural Sciences and Engineering Research Council of Canada.

ResumenSubjectsDatos bibliográficosCiteRelated studies

Abstract (original language)

Network meta‐analysis (NMA) is an extension of pairwise meta‐analysis that facilitates the estimation of relative effects for multiple competing treatments. A hierarchy of treatments is a useful output of an NMA. Treatment hierarchies are produced using ranking metrics. Common ranking metrics include the Surface Under the Cumulative RAnking curve (SUCRA) and P‐scores, which are the frequentist analogue to SUCRAs. Both metrics consider the size and uncertainty of the estimated treatment effects, with larger values indicating a more preferred treatment. Although SUCRAs and P‐scores themselves consider uncertainty, treatment hierarchies produced by these ranking metrics are typically reported without a measure of certainty, which might be misleading to practitioners. We propose a new metric, Precision of Treatment Hierarchy (POTH), which quantifies the certainty in producing a treatment hierarchy from SUCRAs or P‐scores. The metric connects three statistical quantities: The variance of the SUCRA values, the variance of the mean rank of each treatment, and the average variance of the distribution of individual ranks for each treatment. POTH provides a single, interpretable value that quantifies the extent of certainty in producing a treatment hierarchy. We show how the metric can be adapted to apply to subsets of treatments in a network, for example, to quantify the certainty in the hierarchy of the top three treatments. We calculate POTH for a database of NMAs to investigate its empirical properties, and we demonstrate its use on two published networks.

Subjects

MeSH terms (MEDLINE)

Network Meta-Analysis as TopicHumansUncertaintyModels, StatisticalComputer SimulationTreatment Outcome

Author keywords

P‐scorenetwork meta‐analysisrankingsurface under the cumulative ranking curvetreatment hierarchyuncertainty

Authors and institutions

  • Department of Statistics and Actuarial Science, University of Waterloo, Ontario, Canada.
  • Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland.
  • Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany.
  • Department of Primary Education, University of Ioannina, Ioannina, Greece.
  • Laboratory of Hygiene, Social and Preventive Medicine and Medical Statistics, School of Medicine, Aristotle University of Thessaloniki, Thessaloniki, Greece.

ORCID profiles: Audrey Béliveau, Gerta Rücker

Funding

  • Hellenic Foundation for Research and Innovation
  • Deutsche Forschungsgemeinschaft
  • Natural Sciences and Engineering Research Council of Canada

Cite

APA

Wigle, A., Béliveau, A., Salanti, G., Rücker, G., Schwarzer, G., Mavridis, D., & Nikolakopoulou, A. (2025). Precision of Treatment Hierarchy: A Metric for Quantifying Certainty in Treatment Hierarchies From Network Meta‐Analysis. Statistics in Medicine, 44(13-14). https://doi.org/10.1002/sim.70176

Vancouver

Wigle A, Béliveau A, Salanti G, Rücker G, Schwarzer G, Mavridis D, et al. Precision of Treatment Hierarchy: A Metric for Quantifying Certainty in Treatment Hierarchies From Network Meta‐Analysis. Statistics in Medicine. 2025;44(13-14). doi:10.1002/sim.70176

BibTeX
@article{Wigle2025,
  author = {Wigle, Augustine and Béliveau, Audrey and Salanti, Georgia and Rücker, Gerta and Schwarzer, Guido and Mavridis, Dimitris and Nikolakopoulou, Adriani},
  title = {Precision of Treatment Hierarchy: A Metric for Quantifying Certainty in Treatment Hierarchies From Network Meta‐Analysis},
  journal = {Statistics in Medicine},
  year = {2025},
  volume = {44},
  number = {13-14},
  doi = {10.1002/sim.70176}
}
Start for free →