EUVIMEDObjevte EUVIMED
BeobachtungsstudieKohortenstudieOpen access

Evaluation of Machine Learning to Detect Influenza Using Wearable Sensor Data and Patient-Reported Symptoms: Cohort Study

Kamran Farooq iD, Melody Lim iD, Lawrence Dennison-Hall iD, Finn Janson iD, Aspen Hazel Olszewska iD, Muhammad Mamduh Ahmad Zabidi iD, Anna Haratym-Rojek iD, Karol Narowski iD, Barry Clinch iD, Marco Prunotto iD, Devika Chawla iD, Victoria Hunter iD and 1 more

Journal of Medical Internet Research · 2024

DOI: 10.2196/47879 ↗

At a glance

Beobachtungsstudie in Journal of Medical Internet Research, 2024. Written by Kamran Farooq and 12 co-authors. Institution: Roche Data & Analytics Chapter (Data Science), Kaiseraugst, Switzerland. Major MEDLINE topics: Influenza, Human, Machine Learning, Wearable Electronic Devices. Cited 3 times so far (Crossref); 42 references. The full text is freely available in PubMed Central.

AbstraktSubjectsBibliografické údajeCiteRelated studies

Abstract (original language)

Background

Machine learning offers quantitative pattern recognition analysis of wearable device data and has the potential to detect illness onset and monitor influenza-like illness (ILI) in patients who are infected.

Objective

This study aims to evaluate the ability of machine-learning algorithms to distinguish between participants who are influenza positive and influenza negative in a cohort of symptomatic patients with ILI using wearable sensor (activity) data and self-reported symptom data during the latent and early symptomatic periods of ILI.

Methods

This prospective observational cohort study used the extreme gradient boosting (XGBoost) classifier to determine whether a participant was influenza positive or negative based on 3 models using symptom-only data, activity-only data, and combined symptom and activity data. Data were collected from the Home Testing of Respiratory Illness (HTRI) study and FluStudy2020, both conducted between December 2019 and October 2020. The model was developed using the FluStudy2020 data and tested on the HTRI data. Analyses included participants in these studies with an at-home influenza diagnostic test result. Fitbit (Google LLC) devices were used to measure participants’ steps, heart rate, and sleep parameters. Participants detailed their ILI symptoms, health care–seeking behaviors, and quality of life. Model performance was assessed by area under the curve (AUC), balanced accuracy, recall (sensitivity), specificity, precision (positive predictive value), negative predictive value, and weighted harmonic mean of precision and recall (F2) score.

Results

An influenza diagnostic test result was available for 953 and 925 participants in HTRI and FluStudy2020, respectively, of whom 848 (89%) and 840 (90.8%) had activity data. For the training and validation sets, the highest performing model was trained on the combined symptom and activity data (training AUC=0.77; validation AUC=0.74) versus symptom-only (training AUC=0.73; validation AUC=0.72) and activity-only (training AUC=0.68; validation AUC=0.65) data. For the FluStudy2020 test set, the performance of the model trained on combined symptom and activity data was closely aligned with that of the symptom-only model (combined symptom and activity test AUC=0.74; symptom-only test AUC=0.74). These results were validated using independent HTRI data (combined symptom and activity evaluation AUC=0.75; symptom-only evaluation AUC=0.74). The top features guiding influenza detection were cough; mean resting heart rate during main sleep; fever; total minutes in bed for the combined model; and fever, cough, and sore throat for the symptom-only model.

Conclusions

Machine-learning algorithms had moderate accuracy in detecting influenza, suggesting that previous findings from research-grade sensors tested in highly controlled experimental settings may not easily translate to scalable commercial-grade sensors. In the future, more advanced wearable sensors may improve their performance in the early detection and discrimination of viral respiratory infections.

Subjects

MeSH terms (MEDLINE)

Influenza, HumanMachine LearningWearable Electronic DevicesHumansProspective StudiesMaleFemaleAdultMiddle AgedCohort StudiesSelf ReportYoung Adult

Author keywords

influenzainfluenza-like illnessmachine learningperson-generated health care datawearable sensor

Authors and institutions

  • Roche Data & Analytics Chapter (Data Science), Kaiseraugst, Switzerland.
  • Genentech, Inc, South San Francisco, CA, United States.
  • Roche Products Ltd, Welwyn Garden City, United Kingdom.
  • Roche Global IT Solution Centre, Warsaw, Poland.
  • Roche Services & Solutions (Asia Pacific) Sdn Bhd, Subang Jaya, Malaysia.
  • Badger Software Sp z oo, Wroclaw, Poland.

ORCID profiles: Kamran Farooq, Melody Lim, Lawrence Dennison-Hall, Finn Janson, Aspen Hazel Olszewska, Muhammad Mamduh Ahmad Zabidi, Anna Haratym-Rojek, Karol Narowski, Barry Clinch, Marco Prunotto, Devika Chawla, Victoria Hunter, Vincent Ukachukwu

Cite

APA

Farooq, K., Lim, M., Dennison-Hall, L., Janson, F., Olszewska, A. H., Ahmad Zabidi, M. M., Haratym-Rojek, A., Narowski, K., Clinch, B., Prunotto, M., Chawla, D., Hunter, V., & Ukachukwu, V. (2024). Evaluation of Machine Learning to Detect Influenza Using Wearable Sensor Data and Patient-Reported Symptoms: Cohort Study. Journal of Medical Internet Research. https://doi.org/10.2196/47879

Vancouver

Farooq K, Lim M, Dennison-Hall L, Janson F, Olszewska AH, Ahmad Zabidi MM, et al. Evaluation of Machine Learning to Detect Influenza Using Wearable Sensor Data and Patient-Reported Symptoms: Cohort Study. Journal of Medical Internet Research. 2024. doi:10.2196/47879

BibTeX
@article{Farooq2024,
  author = {Farooq, Kamran and Lim, Melody and Dennison-Hall, Lawrence and Janson, Finn and Olszewska, Aspen Hazel and Ahmad Zabidi, Muhammad Mamduh and Haratym-Rojek, Anna and Narowski, Karol and Clinch, Barry and Prunotto, Marco and Chawla, Devika and Hunter, Victoria and Ukachukwu, Vincent},
  title = {Evaluation of Machine Learning to Detect Influenza Using Wearable Sensor Data and Patient-Reported Symptoms: Cohort Study},
  journal = {Journal of Medical Internet Research},
  year = {2024},
  doi = {10.2196/47879}
}
Start for free →