EUVIMEDOpdag EUVIMED
Mixed-Methods-StudieOpen access

Efficient Screening in Obstructive Sleep Apnea Using Sequential Machine Learning Models, Questionnaires, and Pulse Oximetry Signals: Mixed Methods Study

Nai-Yu Kuo iD, Hsin-Jung Tsai iD, Shih-Jen Tsai iD, Albert C Yang iD

Journal of Medical Internet Research · 2024

DOI: 10.2196/51615 ↗

At a glance

Mixed-Methods-Studie in Journal of Medical Internet Research, 2024. Written by Nai-Yu Kuo and 3 co-authors. Institution: Sleep Medicine Center, Taipei Veterans General Hospital, Taipei, Taiwan. Major MEDLINE topics: Sleep Apnea, Obstructive, Oximetry, Machine Learning. Cited 10 times so far (Crossref); 28 references. The full text is freely available in PubMed Central. Funded by: NHLBI NIH HHS.

AbstractSubjectsBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Background

Obstructive sleep apnea (OSA) is a prevalent sleep disorder characterized by frequent pauses or shallow breathing during sleep. Polysomnography, the gold standard for OSA assessment, is time consuming and labor intensive, thus limiting diagnostic efficiency.

Objective

This study aims to develop 2 sequential machine learning models to efficiently screen and differentiate OSA.

Methods

We used 2 datasets comprising 8444 cases from the Sleep Heart Health Study (SHHS) and 1229 cases from Taipei Veterans General Hospital (TVGH). The Questionnaire Model (Model-Questionnaire) was designed to distinguish OSA from primary insomnia using demographic information and Pittsburgh Sleep Quality Index questionnaires, while the Saturation Model (Model-Saturation) categorized OSA severity based on multiple blood oxygen saturation parameters. The performance of the sequential machine learning models in screening and assessing the severity of OSA was evaluated using an independent test set derived from TVGH.

Results

The Model-Questionnaire achieved an F1-score of 0.86, incorporating demographic data and the Pittsburgh Sleep Quality Index. Model-Saturation training by the SHHS dataset displayed an F1-score of 0.82 when using the power spectrum of blood oxygen saturation signals and reached the highest F1-score of 0.85 when considering all saturation-related parameters. Model-saturation training by the TVGH dataset displayed an F1-score of 0.82. The independent test set showed stable results for Model-Questionnaire and Model-Saturation training by the TVGH dataset, but with a slightly decreased F1-score (0.78) in Model-Saturation training by the SHHS dataset. Despite reduced model accuracy across different datasets, precision remained at 0.89 for screening moderate to severe OSA.

Conclusions

Although a composite model using multiple saturation parameters exhibits higher accuracy, optimizing this model by identifying key factors is essential. Both models demonstrated adequate at-home screening capabilities for sleep disorders, particularly for patients unsuitable for in-laboratory sleep studies.

Subjects

MeSH terms (MEDLINE)

Sleep Apnea, ObstructiveOximetryMachine LearningHumansSurveys and QuestionnairesMaleMiddle AgedFemaleAdultMass ScreeningAgedPolysomnography

Author keywords

datasetdiagnosticinsomniamachine learningoxygen saturationpolysomnographyquestionnairescreeningsleep apneasleep disordertrainingutilization

Authors and institutions

  • Sleep Medicine Center, Taipei Veterans General Hospital, Taipei, Taiwan.
  • Institute of Brain Science, National YangMing Chiao Tung University, Taipei, Taiwan.
  • Department of Psychiatry, Taipei Veterans General Hospital, Taipei, Taiwan.
  • Department of Medical Research, Taipei Veterans General Hospital, Taipei, Taiwan.
  • Digital Medicine and Smart Healthcare Research Center, National Yang Ming Chiao Tung University, Taipei, Taiwan.

ORCID profiles: Nai-Yu Kuo, Hsin-Jung Tsai, Shih-Jen Tsai, Albert C Yang

Funding

  • NHLBI NIH HHS

Cite

APA

Kuo, N. Y., Tsai, H. J., Tsai, S. J., & Yang, A. C. (2024). Efficient Screening in Obstructive Sleep Apnea Using Sequential Machine Learning Models, Questionnaires, and Pulse Oximetry Signals: Mixed Methods Study. Journal of Medical Internet Research. https://doi.org/10.2196/51615

Vancouver

Kuo NY, Tsai HJ, Tsai SJ, Yang AC. Efficient Screening in Obstructive Sleep Apnea Using Sequential Machine Learning Models, Questionnaires, and Pulse Oximetry Signals: Mixed Methods Study. Journal of Medical Internet Research. 2024. doi:10.2196/51615

BibTeX
@article{Kuo2024,
  author = {Kuo, Nai-Yu and Tsai, Hsin-Jung and Tsai, Shih-Jen and Yang, Albert C},
  title = {Efficient Screening in Obstructive Sleep Apnea Using Sequential Machine Learning Models, Questionnaires, and Pulse Oximetry Signals: Mixed Methods Study},
  journal = {Journal of Medical Internet Research},
  year = {2024},
  doi = {10.2196/51615}
}
Start for free →