EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Measuring Agreement in Diagnostics: A Practical Guide for Researchers

Sophie Vanbelle, Christina Hernandez Engelhart iD, Ellen Blix

Statistics in Medicine · 2025-10 · 44 (23-24)

DOI: 10.1002/sim.70299 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Statistics in Medicine, online erschienen am 16.10.2025. Verfasst von Sophie Vanbelle und 2 weiteren Autor:innen. Beteiligte Einrichtung: Methodology and Statistics, CAPHRI, Maastricht University, Maastricht, Limburg, the Netherlands. Hauptthemen laut MEDLINE: Cardiotocography. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 62 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Healthcare professionals routinely perform clinical examinations and diagnostic assessments. How the findings of these assessments are interpreted can have significant implications for patient care and outcomes. A recent systematic review on reliability and agreement studies in intrapartum fetal heart rate monitoring highlighted three methodological issues: (1) confusion between the concepts of agreement and reliability, (2) lack of clarity on how agreement and reliability measures are calculated when more than two raters are involved, and (3) confidence intervals seldom reported. This paper aims to clarify how agreement measures can be computed and interpreted when the outcome is binary (e.g., normal/abnormal test result). Using a motivating example in which five experienced obstetricians assessed 20 CTGs, we demonstrate how agreement can be defined, computed, and interpreted in various scenarios. The paper further explains the relationship between agreement measures and the concept of reliability, the distinction between intra‐ and inter‐observer studies, and approaches to make statistical inference and sample size calculations. Particular emphasis is placed on the proportion of agreement, the proportion of specific agreement and kappa coefficients. A shiny application has also been developed to support researchers in their agreement studies. This work completes existing tools such as the Guidelines for Reporting Reliability and Agreement Studies (GRRAS), the Quality Appraisal Tool for Studies of Diagnostic Reliability (QAREL) and STARD guidelines for reporting diagnostic accuracy studies. It is intended to help researchers improve the methodological quality of studies that evaluate the agreement of clinical tests.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

CardiotocographyHumansReproducibility of ResultsObserver VariationPregnancyFemaleData Interpretation, StatisticalHeart Rate, Fetal

Stichwörter der Autor:innen

clinical testconcordanceerrorinterobserverintraobserverobserver variationreliabilityrepeatabilityreproducibility of results

Autor:innen und Institutionen

  • Methodology and Statistics, CAPHRI, Maastricht University, Maastricht, Limburg, the Netherlands.
  • Norwegian Research Center for Women's Health, Oslo University Hospital, Oslo, Norway.
  • Faculty of Health Sciences, Oslo Metropolitan University, Oslo, Norway.

ORCID-Profile: Christina Hernandez Engelhart

Zitieren

APA

Vanbelle, S., Engelhart, C. H., & Blix, E. (2025). Measuring Agreement in Diagnostics: A Practical Guide for Researchers. Statistics in Medicine, 44(23-24). https://doi.org/10.1002/sim.70299

Vancouver

Vanbelle S, Engelhart CH, Blix E. Measuring Agreement in Diagnostics: A Practical Guide for Researchers. Statistics in Medicine. 2025;44(23-24). doi:10.1002/sim.70299

BibTeX
@article{Vanbelle2025,
  author = {Vanbelle, Sophie and Engelhart, Christina Hernandez and Blix, Ellen},
  title = {Measuring Agreement in Diagnostics: A Practical Guide for Researchers},
  journal = {Statistics in Medicine},
  year = {2025},
  volume = {44},
  number = {23-24},
  doi = {10.1002/sim.70299}
}
Kostenlos starten →