Linguistic diversity in machine learning training data: Content analysis of English and Finnish soundscape descriptions in audio captioning
PLOS One · 11.06.2026 · 21 (6) · e0350043
DOI: 10.1371/journal.pone.0350043 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS One, online erschienen am 11.06.2026. Verfasst von Laura Hekanaho und 3 weiteren Autor:innen. Beteiligte Einrichtung: University of Helsinki, Languages, Helsinki, Finland. Hauptthemen laut MEDLINE: Machine Learning, Language, Linguistics. Die Arbeit nennt 72 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Emil Aaltosen Säätiö.
Abstract (Originalsprache)
This article examines descriptions of auditory experiences used as training data in machine learning. While such training datasets play a key role in machine learning, only a few studies have investigated these training datasets from a linguistic perspective. Making an important contribution to the English-focused field, we compare descriptions produced in two typologically distant languages: English and Finnish. The English descriptions were produced by sighted participants, and the Finnish data both by sighted and non-sighted individuals, offering insight into variation in language use based on sensory experience. First, we provide an overview of the three datasets with a descriptive corpus analysis. The corpus analysis reveals greater variation among the Finnish corpora, in comparison with the English corpus. We attribute this to the use of L2 speakers as informants for the English data, considering potential data quality issues from a linguistic perspective. Second, we report on a qualitative content analysis conducted on a smaller sample of 150 descriptions, examining which elements the participants had identified and chosen to verbalize. In particular, the analysis indicates that the visually disabled participants make use of slightly richer lexical resources, especially in terms of verbalising spatial structure. In addition, a methodological finding of our study captures how the corpus-level and the discourse-level analyses lead to distinct, even seemingly contradictory results: while the corpus analysis focuses on token distributions, the qualitative discourse-level analysis reveals which different semantic domains are prevalent in different subcorpora. This article contributes to the growing research on cross-linguistic and language-internal diversity in the field of machine perception.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- University of Helsinki, Languages, Helsinki, Finland.
- Tampere University, Languages Unit, Tampere, Finland.
ORCID-Profile: Laura Hekanaho, Emilia Tuuri, Maija Hirvonen
Förderung
- Emil Aaltosen Säätiö
Zitieren
APA
Hekanaho, L., Tuuri, E., Surakka, M., & Hirvonen, M. (2026). Linguistic diversity in machine learning training data: Content analysis of English and Finnish soundscape descriptions in audio captioning. PLOS One, 21(6), e0350043. https://doi.org/10.1371/journal.pone.0350043
Vancouver
Hekanaho L, Tuuri E, Surakka M, Hirvonen M. Linguistic diversity in machine learning training data: Content analysis of English and Finnish soundscape descriptions in audio captioning. PLOS One. 2026;21(6):e0350043. doi:10.1371/journal.pone.0350043
BibTeX
@article{Hekanaho2026,
author = {Hekanaho, Laura and Tuuri, Emilia and Surakka, Maija and Hirvonen, Maija},
title = {Linguistic diversity in machine learning training data: Content analysis of English and Finnish soundscape descriptions in audio captioning},
journal = {PLOS One},
year = {2026},
volume = {21},
number = {6},
pages = {e0350043},
doi = {10.1371/journal.pone.0350043}
}
EUVIMED