Analytical Validation of a Webcam-Based Assessment of Speech Kinematics: Digital Biomarker Evaluation following the V3 Framework
Digital Biomarkers · 28.04.2023 · 7-17
DOI: 10.1159/000529685 ↗Kurz gefasst
Fachartikel in der Zeitschrift Digital Biomarkers, online erschienen am 28.04.2023. Verfasst von Leif Simmatis und 11 weiteren Autor:innen. Beteiligte Einrichtung: University Health Network, Toronto Rehabilitation Institute, Toronto, ON, Canada. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 15 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: NIDCD NIH HHS.
Abstract (Originalsprache)
Introduction
Kinematic analyses have recently revealed a strong potential to contribute to the assessment of neurological diseases. However, the validation of home-based kinematic assessments using consumer-grade video technology has yet to be performed. In line with best practices for digital biomarker development, we sought to validate webcam-based kinematic assessment against established, laboratory-based recording gold standards. We hypothesized that webcam-based kinematics would possess psychometric properties comparable to those obtained using the laboratory-based gold standards.
Methods
We collected data from 21 healthy participants who repeated the phrase “buy Bobby a puppy” (BBP) at four different combinations of speaking rate and volume: Slow, Normal, Loud, and Fast. We recorded these samples twice back-to-back, simultaneously using (1) an electromagnetic articulography (“EMA”; NDI Wave) system, (2) a 3D camera (Intel RealSense), and (3) a 2D webcam for video recording via an in-house developed app. We focused on the extraction of kinematic features in this study, given their demonstrated value in detecting neurological impairments. We specifically extracted measures of speed/acceleration, range of motion (ROM), variability, and symmetry using the movements of the center of the lower lip during these tasks. Using these kinematic features, we derived measures of (1) agreement between recording methods, (2) test-retest reliability of each method, and (3) the validity of webcam recordings to capture expected changes in kinematics as a result of different speech conditions.
Results
Kinematics measured using the webcam demonstrated good agreement with both the RealSense and EMA (ICC-A values often ≥0.70). Test-retest reliability, measured using the absolute agreement (2,1) formulation of the intraclass correlation coefficient (i.e., ICC-A), was often “moderate” to “strong” (i.e., ≥0.70) and similar between the webcam and EMA-based kinematic features. Finally, the webcam kinematics were typically as sensitive to differences in speech tasks as EMA and the 3D camera gold standards. Discussion and Conclusions: Our results suggested that webcam recordings display good psychometric properties, comparable to laboratory-based gold standards. This work paves the way for a large-scale clinical validation to continue the development of these promising technologies for the assessment of neurological diseases via home-based methods.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- University Health Network, Toronto Rehabilitation Institute, Toronto, ON, Canada.
- Department of Speech-Language Pathology, Rehabilitation Sciences Institute, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada.
- Hurvitz Brain Sciences Program, Sunnybrook Research Institute, Toronto, ON, Canada.
- Clinical Integrative Biology, Sunnybrook Research Institute, Toronto, ON, Canada.
- Department of Applied Physiology and Kinesiology, University of Florida, Gainesville, FL, USA.
- Department of Computer Science, University of Toronto, Toronto, ON, Canada.
Förderung
- NIDCD NIH HHS
Zitieren
APA
Simmatis, L., Alavi Naeini, S., Jafari, D., Xie, M. K. Y., Tanchip, C., Taati, N., McKinlay, S., Sran, R., Truong, J., Guarin, D. L., Taati, B., & Yunusova, Y. (2023). Analytical Validation of a Webcam-Based Assessment of Speech Kinematics: Digital Biomarker Evaluation following the V3 Framework. Digital Biomarkers, 7-17. https://doi.org/10.1159/000529685
Vancouver
Simmatis L, Alavi Naeini S, Jafari D, Xie MKY, Tanchip C, Taati N, et al. Analytical Validation of a Webcam-Based Assessment of Speech Kinematics: Digital Biomarker Evaluation following the V3 Framework. Digital Biomarkers. 2023:7-17. doi:10.1159/000529685
BibTeX
@article{Simmatis2023,
author = {Simmatis, Leif and Alavi Naeini, Saeid and Jafari, Deniz and Xie, Michael Kai Yue and Tanchip, Chelsea and Taati, Niyousha and McKinlay, Scotia and Sran, Rupinder and Truong, Justin and Guarin, Diego L and Taati, Babak and Yunusova, Yana},
title = {Analytical Validation of a Webcam-Based Assessment of Speech Kinematics: Digital Biomarker Evaluation following the V3 Framework},
journal = {Digital Biomarkers},
year = {2023},
pages = {7--17},
doi = {10.1159/000529685}
}
EUVIMED