EUVIMEDOpdag EUVIMED
BeobachtungsstudieOpen access

Developing a Sleep Algxorithm to Support a Digital Medicine System: Noninterventional, Observational Sleep Study

Jeffrey M Cochran iD

JMIR Mental Health · 2024

DOI: 10.2196/62959 ↗

At a glance

Beobachtungsstudie in JMIR Mental Health, 2024. Written by Jeffrey M Cochran. Institution: Otsuka Pharmaceutical Development & Commercialization, Inc, 508 Carnegie Center Drive, Princeton, NJ, 08540, United States, 1 609 535 9035. Major MEDLINE topics: Wearable Electronic Devices, Electrocardiography, Polysomnography, Algorithms. Cited 4 times so far (Crossref); 29 references. The full text is freely available in PubMed Central.

AbstractSubjectsBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Background

Sleep-wake patterns are important behavioral biomarkers for patients with serious mental illness (SMI), providing insight into their well-being. The gold standard for monitoring sleep is polysomnography (PSG), which requires a sleep lab facility; however, advances in wearable sensor technology allow for real-world sleep-wake monitoring.

Objective

The goal of this study was to develop a PSG-validated sleep algorithm using accelerometer (ACC) and electrocardiogram (ECG) data from a wearable patch to accurately quantify sleep in a real-world setting.

Methods

In this noninterventional, nonsignificant-risk, abbreviated investigational device exemption, single-site study, participants wore the reusable wearable sensor version 2 (RW2) patch. The RW2 patch is part of a digital medicine system (aripiprazole with sensor) designed to provide objective records of medication ingestion for patients with schizophrenia, bipolar I disorder, and major depressive disorder. This study developed a sleep algorithm from patch data and did not contain any study-related or digitized medication. Patch-acquired ACC and ECG data were compared against PSG data to build machine learning classification models to distinguish periods of wake from sleep. The PSG data provided sleep stage classifications at 30-second intervals, which were combined into 5-minute windows and labeled as sleep or wake based on the majority of sleep stages within the window. ACC and ECG features were derived for each 5-minute window. The algorithm that most accurately predicted sleep parameters against PSG data was compared to commercially available wearable devices to further benchmark model performance.

Results

Of 80 participants enrolled, 60 had at least 1 night of analyzable ACC and ECG data (25 healthy volunteers and 35 participants with diagnosed SMI). Overall, 10,574 valid 5-minute windows were identified (5854 from participants with SMI), and 84% (n=8830) were classified as greater than half sleep. Of the 3 models tested, the conditional random field algorithm provided the most robust sleep-wake classification. Performance was comparable to the middle 50% of commercial devices evaluated in a recent publication, providing a sleep detection performance of 0.93 (sensitivity) and wake detection performance of 0.60 (specificity) at a prediction probability threshold of 0.75. The conditional random field algorithm retained this performance for individual sleep parameters, including total sleep time, sleep efficiency, and wake after sleep onset (within the middle 50% to top 25% of the assessed devices). The only parameter where the model performance was lower was sleep onset latency (within the bottom 25% of all comparator devices).

Conclusions

Using industry-best practices, we developed a sleep algorithm for use with the RW2 patch that can accurately detect sleep and wake windows compared to PSG-labeled sleep data. This algorithm may be used for a more complete understanding of well-being for patients with SMI in a real-world setting, without the need for PSG and a sleep lab.

Subjects

MeSH terms (MEDLINE)

Wearable Electronic DevicesElectrocardiographyPolysomnographyAlgorithmsHumansMaleFemaleAdultMiddle AgedAccelerometrySleepMachine LearningYoung Adult

Author keywords

accelerometeractigraphyelectrocardiogrammachine learningpolysomnographysleep disordersleep monitoringsleep qualitysleep-wake cycleswearable sensor

Authors and institutions

  • Otsuka Pharmaceutical Development & Commercialization, Inc, 508 Carnegie Center Drive, Princeton, NJ, 08540, United States, 1 609 535 9035.

ORCID profiles: Jeffrey M Cochran

Cite

APA

Cochran, J. M. (2024). Developing a Sleep Algxorithm to Support a Digital Medicine System: Noninterventional, Observational Sleep Study. JMIR Mental Health. https://doi.org/10.2196/62959

Vancouver

Cochran JM. Developing a Sleep Algxorithm to Support a Digital Medicine System: Noninterventional, Observational Sleep Study. JMIR Mental Health. 2024. doi:10.2196/62959

BibTeX
@article{Cochran2024,
  author = {Cochran, Jeffrey M},
  title = {Developing a Sleep Algxorithm to Support a Digital Medicine System: Noninterventional, Observational Sleep Study},
  journal = {JMIR Mental Health},
  year = {2024},
  doi = {10.2196/62959}
}
Start for free →