Intrarater reliability of expert electroencephalographic interpretation of 100 full‐length recordings
Epilepsia · 20.11.2026
DOI: 10.1002/epi.70620 ↗Kurz gefasst
Fachartikel in der Zeitschrift Epilepsia, online erschienen am 20.11.2026. Verfasst von Doyle Yuan und 19 weiteren Autor:innen. Die Arbeit nennt 40 Literaturangaben.
Abstract (Originalsprache)
Objective
The value of electroencephalography (EEG) relies on accurate and reliable interpretation. Prior research has demonstrated imperfect interrater reliability, but intrarater reliability remains poorly characterized. We performed a “noise audit” primarily to measure intrarater variability in EEG interpretation by epileptologists.
Methods
Experts independently rated the same 100 full‐length EEGs on two separate occasions ≥60 days apart, unaware the EEGs were the same. EEGs were recorded from adult (56%) and pediatric patients in outpatient (78%) and non‐critical care inpatient settings. There were 20 studies in each of five categories: normal, focal epileptiform (FE), generalized epileptiform (GE), focal nonepileptiform (FNE), and generalized nonepileptiform (GNE) abnormalities. EEGs were presented using our online platform (EEGHub) without clinical information except for age and sex. Experts rated each recording and indicated their level of confidence (LOC) for each EEG and overall. We analyzed percent as well as chance‐corrected intra‐ and interrater agreement.
Results
Fourteen experts (mean of 19 years EEG reading experience, range = 4–52 years) were included in the study. Percent self‐agreement was 96% for GE, 90% for FE, 88% for FNE, and 87% for GNE abnormalities; 90% for any epileptiform abnormality; and 82% for any nonepileptiform abnormality. Self‐agreement was strongly correlated with interrater agreement (mean κ ML ), which was almost perfect for GE (.90, 95% confidence interval [CI] = .87–.94) and FE (.82, 95% CI = .77–.87) and substantial for GNE (.75, 95% CI = .69–.81) and FNE (.74, 95% CI = .68–.80) abnormalities. LOC correlated with self‐agreement on the presence of nonepileptiform but not epileptiform abnormalities. Significance We found generally strong within‐expert agreement in EEG interpretation, especially in the identification of epileptiform abnormalities. Nevertheless, the number of flipped decisions was high enough to be clinically consequential. This undesired variability (“occasion noise”) may be addressed by interventions to (1) decrease this noise directly and (2) reduce case ambiguity with longer recordings and better EEG data whenever feasible.
Zitieren
APA
Yuan, D., Sheikh, I. S., Katyal, R., Kaplan, P. W., Fotedar, N., Clay, J., Benbadis, S., Richards, S., Schomer, D., Vinayan, K. P., Pacheco, V., Schuele, S., McLaren, J., Lin, K., Fessler, A. J., Yoo, J., Greenblatt, A. S., Beniczky, S., Westover, M. B., & Nascimento, F. A. (2026). Intrarater reliability of expert electroencephalographic interpretation of 100 full‐length recordings. Epilepsia. https://doi.org/10.1002/epi.70620
Vancouver
Yuan D, Sheikh IS, Katyal R, Kaplan PW, Fotedar N, Clay J, et al. Intrarater reliability of expert electroencephalographic interpretation of 100 full‐length recordings. Epilepsia. 2026. doi:10.1002/epi.70620
BibTeX
@article{Yuan2026,
author = {Yuan, Doyle and Sheikh, Irfan S. and Katyal, Roohi and Kaplan, Peter W. and Fotedar, Neel and Clay, Jordan and Benbadis, Selim and Richards, Sindhu and Schomer, Donald and Vinayan, Kollencheri Puthenveettil and Pacheco, Vitor and Schuele, Stephan and McLaren, John and Lin, Katia and Fessler, A. James and Yoo, Jiyeoun and Greenblatt, Adam S. and Beniczky, Sándor and Westover, M. Brandon and Nascimento, Fábio A.},
title = {Intrarater reliability of expert electroencephalographic interpretation of 100 full‐length recordings},
journal = {Epilepsia},
year = {2026},
doi = {10.1002/epi.70620}
}
EUVIMED