EUVIMEDEUVIMED entdecken
Crossref

Establishing the reliability of metrics extracted from long-form recordings using LENA and the ACLEW pipeline

Alejandrina Cristia iD, Lucas Gautheron, Zixing Zhang, Björn Schuller, Camila Scaff, Caroline Rowland, Okko Räsänen, Loann Peurey, Marvin Lavechin, William Havard, Caitlin M Fausey, Margaret Cychosz und 4 weitere

Behavior Research Methods · 2024

DOI: 10.3758/s13428-024-02493-2 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Behavior Research Methods, 2024. Verfasst von Alejandrina Cristia und 15 weiteren Autor:innen. Beteiligte Einrichtung: Laboratoire de Sciences Cognitives et de Psycholinguistique, Département d'Etudes cognitives, ENS, EHESS, CNRS, PSL University, Paris, France. alecri…. Hauptthemen laut MEDLINE: Software, Language Development. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 38 Literaturangaben. Gefördert von: Directorate for Engineering, Agence Nationale de la Recherche, James S. McDonnell Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Long-form audio recordings are increasingly used to study individual variation, group differences, and many other topics in theoretical and applied fields of developmental science, particularly for the description of children's language input (typically speech from adults) and children's language output (ranging from babble to sentences). The proprietary LENA software has been available for over a decade, and with it, users have come to rely on derived metrics like adult word count (AWC) and child vocalization counts (CVC), which have also more recently been derived using an open-source alternative, the ACLEW pipeline. Yet, there is relatively little work assessing the reliability of long-form metrics in terms of the stability of individual differences across time. Filling this gap, we analyzed eight spoken-language datasets: four from North American English-learning infants, and one each from British English-, French-, American English-/Spanish-, and Quechua-/Spanish-learning infants. The audio data were analyzed using two types of processing software: LENA and the ACLEW open-source pipeline. When all corpora were included, we found relatively low to moderate reliability (across multiple recordings, intraclass correlation coefficient attributed to the child identity [Child ICC], was < 50% for most metrics). There were few differences between the two pipelines. Exploratory analyses suggested some differences as a function of child age and corpora. These findings suggest that, while reliability is likely sufficient for various group-level analyses, caution is needed when using either LENA or ACLEW tools to study individual variation. We also encourage improvement of extant tools, specifically targeting accurate measurement of individual variation.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

SoftwareLanguage DevelopmentHumansReproducibility of ResultsInfantFemaleSpeechMaleChild LanguageLanguage

Stichwörter der Autor:innen

AccuracyBig dataDaylong recordingsSpeech technology

Autor:innen und Institutionen

  • Laboratoire de Sciences Cognitives et de Psycholinguistique, Département d'Etudes cognitives, ENS, EHESS, CNRS, PSL University, Paris, France. alecristia@gmail.com.
  • Laboratoire de Sciences Cognitives et de Psycholinguistique, Département d'Etudes cognitives, ENS, EHESS, CNRS, PSL University, Paris, France.
  • Interdisciplinary Centre for Science and Technology Studies (IZWT) Wuppertal, University of Wuppertal, Nordrhein-Westfalen, Germany.
  • School of Computer Science and Electronic Engineering, Hunan University, Changsha, Hunan, China.
  • Technische Universität München, Institute for Human-Machine Communication, Munich, Germany.
  • Imperial College London, GLAM - Group on Language, Audio, & Music, London, UK.

ORCID-Profile: Alejandrina Cristia

Förderung

  • Directorate for Engineering
  • Agence Nationale de la Recherche
  • James S. McDonnell Foundation
  • NIDCD NIH HHS
  • Research Council of Finland
  • Social Sciences and Humanities Research Council of Canada
  • Horizon 2020 Framework Programme
  • GENCI-IDRIS

Zitieren

APA

Cristia, A., Gautheron, L., Zhang, Z., Schuller, B., Scaff, C., Rowland, C., Räsänen, O., Peurey, L., Lavechin, M., Havard, W., Fausey, C. M., Cychosz, M., Bergelson, E., Anderson, H., Al Futaisi, N., & Soderstrom, M. (2024). Establishing the reliability of metrics extracted from long-form recordings using LENA and the ACLEW pipeline. Behavior Research Methods. https://doi.org/10.3758/s13428-024-02493-2

Vancouver

Cristia A, Gautheron L, Zhang Z, Schuller B, Scaff C, Rowland C, et al. Establishing the reliability of metrics extracted from long-form recordings using LENA and the ACLEW pipeline. Behavior Research Methods. 2024. doi:10.3758/s13428-024-02493-2

BibTeX
@article{Cristia2024,
  author = {Cristia, Alejandrina and Gautheron, Lucas and Zhang, Zixing and Schuller, Björn and Scaff, Camila and Rowland, Caroline and Räsänen, Okko and Peurey, Loann and Lavechin, Marvin and Havard, William and Fausey, Caitlin M and Cychosz, Margaret and Bergelson, Elika and Anderson, Heather and Al Futaisi, Najla and Soderstrom, Melanie},
  title = {Establishing the reliability of metrics extracted from long-form recordings using LENA and the ACLEW pipeline},
  journal = {Behavior Research Methods},
  year = {2024},
  doi = {10.3758/s13428-024-02493-2}
}
Kostenlos starten →