Automatic sleep staging for the young and the old – Evaluating age bias in deep learning
Sleep Medicine · 2023-07 · 107 · 18-25
DOI: 10.1016/j.sleep.2023.04.002 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sleep Medicine, 2023-07. Verfasst von Mathias Baumert und 2 weiteren Autor:innen. Beteiligte Einrichtung: Discipline of Biomedical Engineering, School of Electrical and Mechanical Engineering, The University of Adelaide, Adelaide, Australia. Electronic ad…. Hauptthemen laut MEDLINE: Deep Learning. Die Arbeit wurde bisher 30-mal zitiert (Crossref) und nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
BACKGROUND: Various deep-learning systems have been proposed for automated sleep staging. Still, the significance of age-specific underrepresentation in training data and the resulting errors in clinically used sleep metrics are unknown. METHODS: We adopted XSleepNet2, a deep neural network for automated sleep staging, to train and test models using polysomnograms of 1232 children (7.0 ± 1.4 years) and 3757 adults (56.9 ± 19.4 years) and 2788 older adults (mean 80.7 ± 4.2 years). We developed four separate sleep stage classifiers using exclusively pediatric (P), adult (A), older adults (O) as well as PSG from mixed cohorts: pediatric, adult, and older adult (PAO). Results were compared against an alternative sleep stager (DeepSleepNet) for validation purposes. RESULTS: When pediatric PSG was classified by XSleepNet2 exclusively trained on pediatric PSG, the overall accuracy was 88.9%, dropping to 78.9% when subjected to a system trained exclusively on adult PSG. Errors performed by the system staging PSG of older people were comparably lower. However, all systems produced significant errors in clinical markers when considering individual PSG. Results obtained with DeepSleepNet showed similar patterns. CONCLUSION: Underrepresentation of age groups, in particular children, can significantly lower the performance of automatic deep-learning sleep stagers. In general, automated sleep stagers may behave unexpectedly, limiting clinical use. Future evaluation of automated systems must pay attention to PSG-level performance and overall accuracy.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Discipline of Biomedical Engineering, School of Electrical and Mechanical Engineering, The University of Adelaide, Adelaide, Australia. Electronic address: mathias.baumert@adelaide.edu.au.
- Adelaide Medical School, The University of Adelaide, Adelaide, Australia.
- Amazon Alexa, Cambridge, MA, 02142, United States.
Zitieren
APA
Baumert, M., Hartmann, S., & Phan, H. (2023). Automatic sleep staging for the young and the old – Evaluating age bias in deep learning. Sleep Medicine, 107, 18-25. https://doi.org/10.1016/j.sleep.2023.04.002
Vancouver
Baumert M, Hartmann S, Phan H. Automatic sleep staging for the young and the old – Evaluating age bias in deep learning. Sleep Medicine. 2023;107:18-25. doi:10.1016/j.sleep.2023.04.002
BibTeX
@article{Baumert2023,
author = {Baumert, Mathias and Hartmann, Simon and Phan, Huy},
title = {Automatic sleep staging for the young and the old – Evaluating age bias in deep learning},
journal = {Sleep Medicine},
year = {2023},
volume = {107},
pages = {18--25},
doi = {10.1016/j.sleep.2023.04.002}
}
EUVIMED