Precision of Treatment Hierarchy: A Metric for Quantifying Certainty in Treatment Hierarchies From Network Meta‐Analysis
Statistics in Medicine · 2025-06 · 44 (13-14)
DOI: 10.1002/sim.70176 ↗At a glance
Journal article in Statistics in Medicine, published online on 2025-06-21. Written by Augustine Wigle and 6 co-authors. Institution: Department of Statistics and Actuarial Science, University of Waterloo, Ontario, Canada. Major MEDLINE topics: Network Meta-Analysis as Topic. Cited 5 times so far (Crossref); 19 references. The full text is freely available (open access, CC BY-NC 4.0). Funded by: Hellenic Foundation for Research and Innovation, Deutsche Forschungsgemeinschaft, Natural Sciences and Engineering Research Council of Canada.
Abstract (original language)
Network meta‐analysis (NMA) is an extension of pairwise meta‐analysis that facilitates the estimation of relative effects for multiple competing treatments. A hierarchy of treatments is a useful output of an NMA. Treatment hierarchies are produced using ranking metrics. Common ranking metrics include the Surface Under the Cumulative RAnking curve (SUCRA) and P‐scores, which are the frequentist analogue to SUCRAs. Both metrics consider the size and uncertainty of the estimated treatment effects, with larger values indicating a more preferred treatment. Although SUCRAs and P‐scores themselves consider uncertainty, treatment hierarchies produced by these ranking metrics are typically reported without a measure of certainty, which might be misleading to practitioners. We propose a new metric, Precision of Treatment Hierarchy (POTH), which quantifies the certainty in producing a treatment hierarchy from SUCRAs or P‐scores. The metric connects three statistical quantities: The variance of the SUCRA values, the variance of the mean rank of each treatment, and the average variance of the distribution of individual ranks for each treatment. POTH provides a single, interpretable value that quantifies the extent of certainty in producing a treatment hierarchy. We show how the metric can be adapted to apply to subsets of treatments in a network, for example, to quantify the certainty in the hierarchy of the top three treatments. We calculate POTH for a database of NMAs to investigate its empirical properties, and we demonstrate its use on two published networks.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Department of Statistics and Actuarial Science, University of Waterloo, Ontario, Canada.
- Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland.
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany.
- Department of Primary Education, University of Ioannina, Ioannina, Greece.
- Laboratory of Hygiene, Social and Preventive Medicine and Medical Statistics, School of Medicine, Aristotle University of Thessaloniki, Thessaloniki, Greece.
ORCID profiles: Audrey Béliveau, Gerta Rücker
Funding
- Hellenic Foundation for Research and Innovation
- Deutsche Forschungsgemeinschaft
- Natural Sciences and Engineering Research Council of Canada
Cite
APA
Wigle, A., Béliveau, A., Salanti, G., Rücker, G., Schwarzer, G., Mavridis, D., & Nikolakopoulou, A. (2025). Precision of Treatment Hierarchy: A Metric for Quantifying Certainty in Treatment Hierarchies From Network Meta‐Analysis. Statistics in Medicine, 44(13-14). https://doi.org/10.1002/sim.70176
Vancouver
Wigle A, Béliveau A, Salanti G, Rücker G, Schwarzer G, Mavridis D, et al. Precision of Treatment Hierarchy: A Metric for Quantifying Certainty in Treatment Hierarchies From Network Meta‐Analysis. Statistics in Medicine. 2025;44(13-14). doi:10.1002/sim.70176
BibTeX
@article{Wigle2025,
author = {Wigle, Augustine and Béliveau, Audrey and Salanti, Georgia and Rücker, Gerta and Schwarzer, Guido and Mavridis, Dimitris and Nikolakopoulou, Adriani},
title = {Precision of Treatment Hierarchy: A Metric for Quantifying Certainty in Treatment Hierarchies From Network Meta‐Analysis},
journal = {Statistics in Medicine},
year = {2025},
volume = {44},
number = {13-14},
doi = {10.1002/sim.70176}
}
EUVIMED