An approach for determining the reliability of manual and digital scoring of sleep stages
SLEEP · 2023
DOI: 10.1093/sleep/zsad248 ↗Kurz gefasst
Fachartikel in der Zeitschrift SLEEP, 2023. Verfasst von Bethany Gerardy und 7 weiteren Autor:innen. Beteiligte Einrichtung: YRT Limited, Winnipeg, MB, Canada. Hauptthemen laut MEDLINE: Sleep Stages, Sleep. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 15 Literaturangaben.
Abstract (Originalsprache)
Study Objectives Inter-scorer variability in sleep staging is largely due to equivocal epochs that contain features of more than one stage. We propose an approach that recognizes the existence of equivocal epochs and evaluates scorers accordingly.
Methods
Epoch-by-epoch staging was performed on 70 polysomnograms by six qualified technologists and by a digital system (Michele Sleep Scoring [MSS]). Probability that epochs assigned the same stage by only two of the six technologists (minority score) resulted from random occurrence of two errors was calculated and found to be <5%, thereby indicating that the stage assigned is an acceptable variant for the epoch. Acceptable stages were identified in each epoch as stages assigned by at least two technologists. Percent agreement between each technologist and the other five technologists, acting as judges, was determined. Agreement was considered to exist if the stage assigned by the tested scorer was one of the acceptable stages for the epoch. Stage assigned by MSS was likewise considered in agreement if included in the acceptable stages made by the technologists.
Results
Agreement of technologists tested against five qualified judges increased from 80.8% (range 70.5%–86.4% among technologists) when using the majority rule, to 96.1 (89.8%–98.5%) by the proposed approach. Agreement between unedited MSS and same judges was 90.0% and increased to 92.1% after brief editing.
Conclusions
Accounting for equivocal epochs provides a more accurate estimate of a scorer’s (human or digital) competence in scoring sleep stages and reduces inter-scorer disagreements. The proposed approach can be implemented in sleep-scoring training and accreditation programs.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- YRT Limited, Winnipeg, MB, Canada.
- Department of Medicine, Corporal Michael J. Crescenz VA Medical Center, Philadelphia, PA, USA.
- Division of Sleep Medicine/Department of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.
- Department of Psychiatry, Stanford University, Palo Alto, CA, USA.
- Sleep Medicine and Research Center, St. Luke's Hospital, Chesterfield, MO, USA.
- Division of Pulmonary and Critical Care Medicine, Department of Medicine, Johns Hopkins School of Medicine, Johns Hopkins University, Baltimore, MD, USA.
ORCID-Profile: Allan Pack, Clete A Kushida
Zitieren
APA
Gerardy, B., Kuna, S. T., Pack, A., Kushida, C. A., Walsh, J. K., Staley, B., Pien, G. W., & Younes, M. (2023). An approach for determining the reliability of manual and digital scoring of sleep stages. SLEEP. https://doi.org/10.1093/sleep/zsad248
Vancouver
Gerardy B, Kuna ST, Pack A, Kushida CA, Walsh JK, Staley B, et al. An approach for determining the reliability of manual and digital scoring of sleep stages. SLEEP. 2023. doi:10.1093/sleep/zsad248
BibTeX
@article{Gerardy2023,
author = {Gerardy, Bethany and Kuna, Samuel T and Pack, Allan and Kushida, Clete A and Walsh, James K and Staley, Bethany and Pien, Grace W and Younes, Magdy},
title = {An approach for determining the reliability of manual and digital scoring of sleep stages},
journal = {SLEEP},
year = {2023},
doi = {10.1093/sleep/zsad248}
}
EUVIMED