HabitSense: A Privacy-Aware, AI-Enhanced Multimodal Wearable Platform for mHealth Applications
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · 22.08.2024 · 8 (3) · 1-48
DOI: 10.1145/3678591 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, online erschienen am 09.09.2024. Verfasst von Glenn J Fernandes und 11 weiteren Autor:innen. Beteiligte Einrichtung: Northwestern University, USA. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 83 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NIDDK NIH HHS, NIBIB NIH HHS, National Institute of Diabetes and Digestive and Kidney Diseases.
Abstract (Originalsprache)
Wearable cameras provide an objective method to visually confirm and automate the detection of health-risk behaviors such as smoking and overeating, which is critical for developing and testing adaptive treatment interventions. Despite the potential of wearable camera systems, adoption is hindered by inadequate clinician input in the design, user privacy concerns, and user burden. To address these barriers, we introduced HabitSense, an open-source1, multi-modal neck-worn platform developed with input from focus groups with clinicians (N=36) and user feedback from in-wild studies involving 105 participants over 35 days. Optimized for monitoring health-risk behaviors, the platform utilizes RGB, thermal, and inertial measurement unit sensors to detect eating and smoking events in real time. In a 7-day study involving 15 participants, HabitSense recorded 768 hours of footage, capturing 420.91 minutes of hand-to-mouth gestures associated with eating and smoking data crucial for training machine learning models, achieving a 92% F1-score in gesture recognition. To address privacy concerns, the platform records only during likely health-risk behavior events using SECURE, a smart activation algorithm. Additionally, HabitSense employs on-device obfuscation algorithms that selectively obfuscate the background during recording, maintaining individual privacy while leaving gestures related to health-risk behaviors unobfuscated. Our implementation of SECURE has resulted in a 48% reduction in storage needs and a 30% increase in battery life. This paper highlights the critical roles of clinician feedback, extensive field testing, and privacy-enhancing algorithms in developing an unobtrusive, lightweight, and reproducible wearable system that is both feasible and acceptable for monitoring health-risk behaviors in real-world settings.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Northwestern University, USA.
- University of North Texas, USA.
- Georgia Institute of Technology, USA.
ORCID-Profile: Glenn J Fernandes, Jiayi Zheng, Mahdi Pedram, Christopher Romano, Farzad Shahabi, Blaine Rothrock, Thomas Cohen, Helen Zhu, Tanmeet S Butani, Josiah Hester, Aggelos K Katsaggelos, Nabil Alshurafa
Förderung
- NIDDK NIH HHS
- NIBIB NIH HHS
- National Institute of Diabetes and Digestive and Kidney Diseases
- National Institute of Biomedical Imaging and Bioengineering
Zitieren
APA
Fernandes, G. J., Zheng, J., Pedram, M., Romano, C., Shahabi, F., Rothrock, B., Cohen, T., Zhu, H., Butani, T. S., Hester, J., Katsaggelos, A. K., & Alshurafa, N. (2024). HabitSense: A Privacy-Aware, AI-Enhanced Multimodal Wearable Platform for mHealth Applications. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 8(3), 1-48. https://doi.org/10.1145/3678591
Vancouver
Fernandes GJ, Zheng J, Pedram M, Romano C, Shahabi F, Rothrock B, et al. HabitSense: A Privacy-Aware, AI-Enhanced Multimodal Wearable Platform for mHealth Applications. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. 2024;8(3):1-48. doi:10.1145/3678591
BibTeX
@article{Fernandes2024,
author = {Fernandes, Glenn J and Zheng, Jiayi and Pedram, Mahdi and Romano, Christopher and Shahabi, Farzad and Rothrock, Blaine and Cohen, Thomas and Zhu, Helen and Butani, Tanmeet S and Hester, Josiah and Katsaggelos, Aggelos K and Alshurafa, Nabil},
title = {HabitSense: A Privacy-Aware, AI-Enhanced Multimodal Wearable Platform for mHealth Applications},
journal = {Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies},
year = {2024},
volume = {8},
number = {3},
pages = {1--48},
doi = {10.1145/3678591}
}
EUVIMED