Comparative Assessment of Multimodal Sensor Data Quality Collected Using Android and iOS Smartphones in Real-World Settings
Sensors · 2024
DOI: 10.3390/s24196246 ↗At a glance
Vergleichsstudie in Sensors, 2024. Written by Ramzi Halabi and 8 co-authors. Institution: Centre for Addiction and Mental Health, Toronto, ON M6J 1H4, Canada. Major MEDLINE topics: Smartphone, Accelerometry. Cited 12 times so far (Crossref); 62 references. The full text is freely available (open access, CC BY 4.0). Funded by: Krembil Foundation, Centre for Addiction and Mental Health Discovery Fund, Krembil Foundation, Canada.
Abstract (original language)
Healthcare researchers are increasingly utilizing smartphone sensor data as a scalable and cost-effective approach to studying individualized health-related behaviors in real-world settings. However, to develop reliable and robust digital behavioral signatures that may help in the early prediction of the individualized disease trajectory and future prognosis, there is a critical need to quantify the potential variability that may be present in the underlying sensor data due to variations in the smartphone hardware and software used by large population. Using sensor data collected in real-world settings from 3000 participants’ smartphones for up to 84 days, we compared differences in the completeness, correctness, and consistency of the three most common smartphone sensors—the accelerometer, gyroscope, and GPS— within and across Android and iOS devices. Our findings show considerable variation in sensor data quality within and across Android and iOS devices. Sensor data from iOS devices showed significantly lower levels of anomalous point density (APD) compared to Android across all sensors (p < 1 × 10−4). iOS devices showed a considerably lower missing data ratio (MDR) for the accelerometer compared to the GPS data (p < 1 × 10−4). Notably, the quality features derived from raw sensor data across devices alone could predict the device type (Android vs. iOS) with an up to 0.98 accuracy 95% CI [0.977, 0.982]. Such significant differences in sensor data quantity and quality gathered from iOS and Android platforms could lead to considerable variation in health-related inference derived from heterogenous consumer-owned smartphones. Our research highlights the importance of assessing, measuring, and adjusting for such critical differences in smartphone sensor-based assessments. Understanding the factors contributing to the variation in sensor data based on daily device usage will help develop reliable, standardized, inclusive, and practically applicable digital behavioral patterns that may be linked to health outcomes in real-world settings.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Centre for Addiction and Mental Health, Toronto, ON M6J 1H4, Canada.
- Sage Bionetworks, Seattle, WA 98121, USA.
- Department of Psychiatry, University of Toronto, Toronto, ON M5S 1A1, Canada.
- Vector Institute for Artificial Intelligence, Toronto, ON M5T 1R8, Canada.
- Institute of Psychiatry, Psychology & Neuroscience, King's College London, London WC2R 2LS, UK.
- Department of Biomedical Informatics and Medical Education, University of Washington, Seattle, WA 98195, USA.
ORCID profiles: Ramzi Halabi, Xueying Li, Elias Chaibub Neto
Funding
- Krembil Foundation
- Centre for Addiction and Mental Health Discovery Fund
- Krembil Foundation, Canada
- SC1712603 Warfighter Analytics using Smartphones for Health (WASH) (PI: Bracken)
- United States Air Force and DARPA
Cite
APA
Halabi, R., Selvarajan, R., Lin, Z., Herd, C., Li, X., Kabrit, J., Tummalacherla, M., Chaibub Neto, E., & Pratap, A. (2024). Comparative Assessment of Multimodal Sensor Data Quality Collected Using Android and iOS Smartphones in Real-World Settings. Sensors. https://doi.org/10.3390/s24196246
Vancouver
Halabi R, Selvarajan R, Lin Z, Herd C, Li X, Kabrit J, et al. Comparative Assessment of Multimodal Sensor Data Quality Collected Using Android and iOS Smartphones in Real-World Settings. Sensors. 2024. doi:10.3390/s24196246
BibTeX
@article{Halabi2024,
author = {Halabi, Ramzi and Selvarajan, Rahavi and Lin, Zixiong and Herd, Calvin and Li, Xueying and Kabrit, Jana and Tummalacherla, Meghasyam and Chaibub Neto, Elias and Pratap, Abhishek},
title = {Comparative Assessment of Multimodal Sensor Data Quality Collected Using Android and iOS Smartphones in Real-World Settings},
journal = {Sensors},
year = {2024},
doi = {10.3390/s24196246}
}
EUVIMED