Direct Quantification of Uncertainty in Deep Learning-Based Automatic Sleep Staging
IEEE Transactions on Biomedical Engineering · 2026-06 · 73 (6) · 2144-2154
DOI: 10.1109/tbme.2025.3623380 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Biomedical Engineering, 2026-06. Verfasst von Miika Vainikka und 4 weiteren Autor:innen. Hauptthemen laut MEDLINE: Deep Learning, Sleep Stages, Polysomnography, Electroencephalography. Die Arbeit nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Union's Horizon 2020 Research and Innovation Programme, Finnish Cultural Foundation — Central Fund, State Research Funding for University-Level Health Research, Kuopio University Hospital.
Abstract (Originalsprache)
OBJECTIVE: To evaluate and compare different methods for quantifying uncertainty in deep learning-based automatic sleep staging, thereby enhancing transparency and supporting clinical adoption. METHODS: Three models trained on the STAGES dataset were analyzed. One model used a traditional hypnodensity threshold to assess uncertainty. Two additional models employed Monte Carlo (MC) dropout with different dropout architectures to sample hypnodensities. For these, uncertainty was quantified using thresholds on the mean hypnodensity and the standard deviation. A novel Hypnodensity Interval (HI) method was also introduced, combining the sample mean and standard deviation for uncertainty assessment. All methods were evaluated on the independent DOD dataset by measuring performance improvements after removing uncertain epochs. RESULTS: All models achieved at least 83% accuracy in sleep staging. Among the MC dropout models, the mean hypnodensity threshold yielded the greatest performance improvement (92% accuracy with 20% of the most uncertain data removed), while the standard deviation threshold was less effective. The HI method performed comparably to traditional hypnodensity thresholding and effectively identified uncertainty, particularly in misclassifications between N2 and N3 sleep stages. CONCLUSION: Uncertainty in automatic sleep staging can be reliably quantified directly from hypnodensity outputs. The HI method offers a viable alternative to existing approaches, providing both justifiable thresholding and greater flexibility. SIGNIFICANCE: These findings support the clinical integration of automatic sleep staging systems by improving decision-making transparency and enabling targeted manual review of uncertain epochs without sacrificing overall accuracy.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Förderung
- European Union's Horizon 2020 Research and Innovation Programme
- Finnish Cultural Foundation — Central Fund
- State Research Funding for University-Level Health Research, Kuopio University Hospital
Zitieren
APA
Vainikka, M., Huttunen, R., Kainulainen, S., Korkalainen, H., & Rusanen, M. (2026). Direct Quantification of Uncertainty in Deep Learning-Based Automatic Sleep Staging. IEEE Transactions on Biomedical Engineering, 73(6), 2144-2154. https://doi.org/10.1109/tbme.2025.3623380
Vancouver
Vainikka M, Huttunen R, Kainulainen S, Korkalainen H, Rusanen M. Direct Quantification of Uncertainty in Deep Learning-Based Automatic Sleep Staging. IEEE Transactions on Biomedical Engineering. 2026;73(6):2144-2154. doi:10.1109/tbme.2025.3623380
BibTeX
@article{Vainikka2026,
author = {Vainikka, Miika and Huttunen, Riku and Kainulainen, Samu and Korkalainen, Henri and Rusanen, Matias},
title = {Direct Quantification of Uncertainty in Deep Learning-Based Automatic Sleep Staging},
journal = {IEEE Transactions on Biomedical Engineering},
year = {2026},
volume = {73},
number = {6},
pages = {2144--2154},
doi = {10.1109/tbme.2025.3623380}
}
EUVIMED