EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Repeatability of Commonly Used Speech and Language Features for Clinical Applications

Gabriela M Stegmann, Shira Hahn, Julie Liss, Jeremy Shefner, Seward B Rutkove, Kan Kawabata, Samarth Bhandari, Kerisa Shelton, Cayla Jessica Duncan, Visar Berisha

Digital Biomarkers · 02.12.2020 · 4 (3) · 109-122

DOI: 10.1159/000511671 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Digital Biomarkers, online erschienen am 02.12.2020. Verfasst von Gabriela M Stegmann und 9 weiteren Autor:innen. Beteiligte Einrichtung: Arizona State University, Phoenix, Arizona, USA. Die Arbeit wurde bisher 49-mal zitiert (Crossref) und nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: NIDCD NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

Changes in speech have the potential to provide important information on the diagnosis and progression of various neurological diseases. Many researchers have relied on open-source speech features to develop algorithms for measuring speech changes in clinical populations as they are convenient and easy to use. However, the repeatability of open-source features in the context of neurological diseases has not been studied.

Methods

We used a longitudinal sample of healthy controls, individuals with amyotrophic lateral sclerosis, and individuals with suspected frontotemporal dementia, and we evaluated the repeatability of acoustic and language features separately on these 3 data sets.

Results

Repeatability was evaluated using intraclass correlation (ICC) and the within-subjects coefficient of variation (WSCV). In 3 sets of tasks, the median ICC were between 0.02 and 0.55, and the median WSCV were between 29 and 79%.

Conclusion

Our results demonstrate that the repeatability of speech features extracted using open-source tool kits is low. Researchers should exercise caution when developing digital health models with open-source speech features. We provide a detailed summary of feature-by-feature repeatability results (ICC, WSCV, SE of measurement, limits of agreement for WSCV, and minimal detectable change) in the online supplementary material so that researchers may incorporate repeatability information into the models they develop.

Schlagwörter

Stichwörter der Autor:innen

Automatic speech analysisDigital biomarkersMobile technologyRepeatabilitySpeech

Autor:innen und Institutionen

  • Arizona State University, Phoenix, Arizona, USA.
  • Aural Analytics, Scottsdale, Arizona, USA.
  • Barrow Neurological Institute, Phoenix, Arizona, USA.
  • Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA.

Förderung

  • NIDCD NIH HHS

Zitieren

APA

Stegmann, G. M., Hahn, S., Liss, J., Shefner, J., Rutkove, S. B., Kawabata, K., Bhandari, S., Shelton, K., Duncan, C. J., & Berisha, V. (2020). Repeatability of Commonly Used Speech and Language Features for Clinical Applications. Digital Biomarkers, 4(3), 109-122. https://doi.org/10.1159/000511671

Vancouver

Stegmann GM, Hahn S, Liss J, Shefner J, Rutkove SB, Kawabata K, et al. Repeatability of Commonly Used Speech and Language Features for Clinical Applications. Digital Biomarkers. 2020;4(3):109-122. doi:10.1159/000511671

BibTeX
@article{Stegmann2020,
  author = {Stegmann, Gabriela M and Hahn, Shira and Liss, Julie and Shefner, Jeremy and Rutkove, Seward B and Kawabata, Kan and Bhandari, Samarth and Shelton, Kerisa and Duncan, Cayla Jessica and Berisha, Visar},
  title = {Repeatability of Commonly Used Speech and Language Features for Clinical Applications},
  journal = {Digital Biomarkers},
  year = {2020},
  volume = {4},
  number = {3},
  pages = {109--122},
  doi = {10.1159/000511671}
}
Kostenlos starten →