EUVIMEDEUVIMED entdecken
Multizentrische StudieOpen Access

Accuracy of 11 Wearable, Nearable, and Airable Consumer Sleep Trackers: Prospective Multicenter Validation Study

Taeyoung Lee iD, Younghoon Cho iD, Kwang Su Cha iD, Jinhwan Jung iD, Jungim Cho iD, Hyunggug Kim iD, Daewoo Kim iD, Joonki Hong iD, Dongheon Lee iD, Moonsik Keum iD, Clete A Kushida iD, In-Young Yoon iD und 1 weitere

JMIR mHealth and uHealth · 02.11.2023 · 11 · e50983

DOI: 10.2196/50983 ↗

Kurz gefasst

Multizentrische Studie in der Zeitschrift JMIR mHealth and uHealth, online erschienen am 02.11.2023. Verfasst von Taeyoung Lee und 12 weiteren Autor:innen. Beteiligte Einrichtung: Asleep Co., Ltd., Seoul, Republic of Korea. Hauptthemen laut MEDLINE: Sleep, Sleep Stages. Die Arbeit wurde bisher 126-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Consumer sleep trackers (CSTs) have gained significant popularity because they enable individuals to conveniently monitor and analyze their sleep. However, limited studies have comprehensively validated the performance of widely used CSTs. Our study therefore investigated popular CSTs based on various biosignals and algorithms by assessing the agreement with polysomnography.

Objective

This study aimed to validate the accuracy of various types of CSTs through a comparison with in-lab polysomnography. Additionally, by including widely used CSTs and conducting a multicenter study with a large sample size, this study seeks to provide comprehensive insights into the performance and applicability of these CSTs for sleep monitoring in a hospital environment.

Methods

The study analyzed 11 commercially available CSTs, including 5 wearables (Google Pixel Watch, Galaxy Watch 5, Fitbit Sense 2, Apple Watch 8, and Oura Ring 3), 3 nearables (Withings Sleep Tracking Mat, Google Nest Hub 2, and Amazon Halo Rise), and 3 airables (SleepRoutine, SleepScore, and Pillow). The 11 CSTs were divided into 2 groups, ensuring maximum inclusion while avoiding interference between the CSTs within each group. Each group (comprising 8 CSTs) was also compared via polysomnography.

Results

The study enrolled 75 participants from a tertiary hospital and a primary sleep-specialized clinic in Korea. Across the 2 centers, we collected a total of 3890 hours of sleep sessions based on 11 CSTs, along with 543 hours of polysomnography recordings. Each CST sleep recording covered an average of 353 hours. We analyzed a total of 349,114 epochs from the 11 CSTs compared with polysomnography, where epoch-by-epoch agreement in sleep stage classification showed substantial performance variation. More specifically, the highest macro F1 score was 0.69, while the lowest macro F1 score was 0.26. Various sleep trackers exhibited diverse performances across sleep stages, with SleepRoutine excelling in the wake and rapid eye movement stages, and wearables like Google Pixel Watch and Fitbit Sense 2 showing superiority in the deep stage. There was a distinct trend in sleep measure estimation according to the type of device. Wearables showed high proportional bias in sleep efficiency, while nearables exhibited high proportional bias in sleep latency. Subgroup analyses of sleep trackers revealed variations in macro F1 scores based on factors, such as BMI, sleep efficiency, and apnea-hypopnea index, while the differences between male and female subgroups were minimal.

Conclusions

Our study showed that among the 11 CSTs examined, specific CSTs showed substantial agreement with polysomnography, indicating their potential application in sleep monitoring, while other CSTs were partially consistent with polysomnography. This study offers insights into the strengths of CSTs within the 3 different classes for individuals interested in wellness who wish to understand and proactively manage their own sleep.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

SleepSleep StagesHumansFemaleMaleProspective StudiesPolysomnographyFitness Trackers

Stichwörter der Autor:innen

Fitbit Sense 2, Amazon Halo Rise, SleepRoutineairablesartificial intelligencecomparative studyconsumer sleep trackersdeep learningmulticenter studynearablespolysomnographysleep monitoringsleep stagewearables

Autor:innen und Institutionen

  • Asleep Co., Ltd., Seoul, Republic of Korea.
  • Clionic Lifecare Clinic, Seoul, Republic of Korea.
  • Department of Psychiatry and Behavioral Sciences, Stanford University Medical Center, Redwood City, CA, United States.
  • Department of Psychiatry, Seoul National University Bundang Hospital, Seongnam-si, Republic of Korea.
  • Department of Otorhinolaryngology-Head and Neck Surgery, Seoul National University Bundang Hospital, Seongnam-si, Republic of Korea.

ORCID-Profile: Taeyoung Lee, Younghoon Cho, Kwang Su Cha, Jinhwan Jung, Jungim Cho, Hyunggug Kim, Daewoo Kim, Joonki Hong, Dongheon Lee, Moonsik Keum, Clete A Kushida, In-Young Yoon, Jeong-Whun Kim

Zitieren

APA

Lee, T., Cho, Y., Cha, K. S., Jung, J., Cho, J., Kim, H., Kim, D., Hong, J., Lee, D., Keum, M., Kushida, C. A., Yoon, I. Y., & Kim, J. W. (2023). Accuracy of 11 Wearable, Nearable, and Airable Consumer Sleep Trackers: Prospective Multicenter Validation Study. JMIR mHealth and uHealth, 11, e50983. https://doi.org/10.2196/50983

Vancouver

Lee T, Cho Y, Cha KS, Jung J, Cho J, Kim H, et al. Accuracy of 11 Wearable, Nearable, and Airable Consumer Sleep Trackers: Prospective Multicenter Validation Study. JMIR mHealth and uHealth. 2023;11:e50983. doi:10.2196/50983

BibTeX
@article{Lee2023,
  author = {Lee, Taeyoung and Cho, Younghoon and Cha, Kwang Su and Jung, Jinhwan and Cho, Jungim and Kim, Hyunggug and Kim, Daewoo and Hong, Joonki and Lee, Dongheon and Keum, Moonsik and Kushida, Clete A and Yoon, In-Young and Kim, Jeong-Whun},
  title = {Accuracy of 11 Wearable, Nearable, and Airable Consumer Sleep Trackers: Prospective Multicenter Validation Study},
  journal = {JMIR mHealth and uHealth},
  year = {2023},
  volume = {11},
  pages = {e50983},
  doi = {10.2196/50983}
}
Kostenlos starten →