Comparing methods for assessing the reliability of health care quality measures
Statistics in Medicine · 2024
DOI: 10.1002/sim.10197 ↗At a glance
Vergleichsstudie in Statistics in Medicine, 2024. Written by Kenneth J Nieser and 1 co-authors. Institution: Center for Innovation to Implementation, VA Palo Alto Health Care System, Menlo Park, California. Major MEDLINE topics: Quality Indicators, Health Care. Cited 9 times so far (Crossref); 45 references. The full text is freely available in PubMed Central. Funded by: HSRD VA, U.S. Department of Veterans Affairs.
Abstract (original language)
Quality measurement plays an increasing role in U.S. health care. Measures inform quality improvement efforts, public reporting of variations in quality of care across providers and hospitals, and high‐stakes financial decisions. To be meaningful in these contexts, measures should be reliable and not heavily impacted by chance variations in sampling or measurement. Several different methods are used in practice by measure developers and endorsers to evaluate reliability; however, there is uncertainty and debate over differences between these methods and their interpretations. We review methods currently used in practice, pointing out differences that can lead to disparate reliability estimates. We compare estimates from 14 different methods in the case of two sets of mental health quality measures within a large health system. We find that estimates can differ substantially and that these discrepancies widen when sample size is reduced.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Center for Innovation to Implementation, VA Palo Alto Health Care System, Menlo Park, California.
- Stanford-Surgery Policy Improvement Research and Education Center, Department of Surgery, Stanford University, Stanford, California.
ORCID profiles: Kenneth J Nieser
Funding
- HSRD VA
- U.S. Department of Veterans Affairs
Cite
APA
Nieser, K. J., & Harris, A. H. S. (2024). Comparing methods for assessing the reliability of health care quality measures. Statistics in Medicine. https://doi.org/10.1002/sim.10197
Vancouver
Nieser KJ, Harris AHS. Comparing methods for assessing the reliability of health care quality measures. Statistics in Medicine. 2024. doi:10.1002/sim.10197
BibTeX
@article{Nieser2024,
author = {Nieser, Kenneth J and Harris, Alex H S},
title = {Comparing methods for assessing the reliability of health care quality measures},
journal = {Statistics in Medicine},
year = {2024},
doi = {10.1002/sim.10197}
}
EUVIMED