Controlled and Real-Life Investigation of Optical Tracking Sensors in Smart Glasses for Monitoring Eating Behavior Using Deep Learning: Cross-Sectional Study
JMIR mHealth and uHealth · 2024
DOI: 10.2196/59469 ↗At a glance
Querschnittstudie in JMIR mHealth and uHealth, 2024. Written by Simon Stankoski and 9 co-authors. Institution: Emteq Ltd., Brighton, United Kingdom. Major MEDLINE topics: Deep Learning, Feeding Behavior, Smart Glasses. Cited 15 times so far (Crossref); 34 references. The full text is freely available in PubMed Central.
Abstract (original language)
Background
The increasing prevalence of obesity necessitates innovative approaches to better understand this health crisis, particularly given its strong connection to chronic diseases such as diabetes, cancer, and cardiovascular conditions. Monitoring dietary behavior is crucial for designing effective interventions that help decrease obesity prevalence and promote healthy lifestyles. However, traditional dietary tracking methods are limited by participant burden and recall bias. Exploring microlevel eating activities, such as meal duration and chewing frequency, in addition to eating episodes, is crucial due to their substantial relation to obesity and disease risk.
Objective
The primary objective of the study was to develop an accurate and noninvasive system for automatically monitoring eating and chewing activities using sensor-equipped smart glasses. The system distinguishes chewing from other facial activities, such as speaking and teeth clenching. The secondary objective was to evaluate the system’s performance on unseen test users using a combination of laboratory-controlled and real-life user studies. Unlike state-of-the-art studies that focus on detecting full eating episodes, our approach provides a more granular analysis by specifically detecting chewing segments within each eating episode.
Methods
The study uses OCO optical sensors embedded in smart glasses to monitor facial muscle activations related to eating and chewing activities. The sensors measure relative movements on the skin’s surface in 2 dimensions (X and Y). Data from these sensors are analyzed using deep learning (DL) to distinguish chewing from other facial activities. To address the temporal dependence between chewing events in real life, we integrate a hidden Markov model as an additional component that analyzes the output from the DL model.
Results
Statistical tests of mean sensor activations revealed statistically significant differences across all 6 comparison pairs (P
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Emteq Ltd., Brighton, United Kingdom.
- Faculty of Informatics, Università della Svizzera Italiana, Lugano, Switzerland.
- Faculty of Electrical Engineering and Information Technologies, Saints Cyril and Methodius University in Skopje, Skopje, the Former Yugoslav Republic of Macedonia.
ORCID profiles: Simon Stankoski, Ivana Kiprijanovska, Martin Gjoreski, Filip Panchevski, Borjan Sazdov, Bojan Sofronievski, Andrew Cleal, Mohsen Fatoorechi, Charles Nduka, Hristijan Gjoreski
Cite
APA
Stankoski, S., Kiprijanovska, I., Gjoreski, M., Panchevski, F., Sazdov, B., Sofronievski, B., Cleal, A., Fatoorechi, M., Nduka, C., & Gjoreski, H. (2024). Controlled and Real-Life Investigation of Optical Tracking Sensors in Smart Glasses for Monitoring Eating Behavior Using Deep Learning: Cross-Sectional Study. JMIR mHealth and uHealth. https://doi.org/10.2196/59469
Vancouver
Stankoski S, Kiprijanovska I, Gjoreski M, Panchevski F, Sazdov B, Sofronievski B, et al. Controlled and Real-Life Investigation of Optical Tracking Sensors in Smart Glasses for Monitoring Eating Behavior Using Deep Learning: Cross-Sectional Study. JMIR mHealth and uHealth. 2024. doi:10.2196/59469
BibTeX
@article{Stankoski2024,
author = {Stankoski, Simon and Kiprijanovska, Ivana and Gjoreski, Martin and Panchevski, Filip and Sazdov, Borjan and Sofronievski, Bojan and Cleal, Andrew and Fatoorechi, Mohsen and Nduka, Charles and Gjoreski, Hristijan},
title = {Controlled and Real-Life Investigation of Optical Tracking Sensors in Smart Glasses for Monitoring Eating Behavior Using Deep Learning: Cross-Sectional Study},
journal = {JMIR mHealth and uHealth},
year = {2024},
doi = {10.2196/59469}
}
EUVIMED