EUVIMEDEUVIMED entdecken
Crossref

L1 influence on stability in speech foundation model-based articulatory mapping of L2 English speech

Yoonjeong Lee, Jihwan Lee, Shrikanth Narayanan

The Journal of the Acoustical Society of America · 01.10.2025 · 158 (4_Supplement) · A194-A195

DOI: 10.1121/10.0040574 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Journal of the Acoustical Society of America, erschienen am 01.10.2025. Verfasst von Yoonjeong Lee und 2 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study investigates how first language (L1) phonological systems affect the stability of articulatory-to-acoustic inversion (AAI) in second language (L2) English speech using a speech foundation model-based approach. We leverage an AAI system built on WavLM-large, pretrained on 94 000 h of English audio from diverse domains and further trained to predict articulatory trajectories using electromagnetic articulography data from a native English speaker. This supervision enables the model to approximate vocal tract movements but encodes English L1 articulatory priors, limiting generalization to diverse L2 backgrounds. We hypothesize that speakers of languages with rhythmic structures and segmental inventories similar to English will exhibit more stable AAI, while speakers of more divergent L1s will show greater trajectory mismatch. Inversion performance was evaluated using a round-trip resynthesis procedure comparing inferred articulatory trajectories before and after resynthesis, using two publicly available corpora (L2-ARCTIC & CMU ARCTIC). Results show systematic variation across L1s. Speakers of Germanic languages (English varieties, German) tend to yield more stable inversion, while speakers of syllable-timed (Spanish, Korean), tonal (Mandarin, Vietnamese), or laryngeally complex (Arabic, Hebrew, Indian varieties) languages show greater mismatch. Our findings offer evidence of L1-driven articulatory biases, highlighting the need for typologically informed approaches to articulatory supervision. [Work supported by IARPA.]

Zitieren

APA

Lee, Y., Lee, J., & Narayanan, S. (2025). L1 influence on stability in speech foundation model-based articulatory mapping of L2 English speech. The Journal of the Acoustical Society of America, 158(4_Supplement), A194-A195. https://doi.org/10.1121/10.0040574

Vancouver

Lee Y, Lee J, Narayanan S. L1 influence on stability in speech foundation model-based articulatory mapping of L2 English speech. The Journal of the Acoustical Society of America. 2025;158(4_Supplement):A194-A195. doi:10.1121/10.0040574

BibTeX
@article{Lee2025,
  author = {Lee, Yoonjeong and Lee, Jihwan and Narayanan, Shrikanth},
  title = {L1 influence on stability in speech foundation model-based articulatory mapping of L2 English speech},
  journal = {The Journal of the Acoustical Society of America},
  year = {2025},
  volume = {158},
  number = {4_Supplement},
  pages = {A194--A195},
  doi = {10.1121/10.0040574}
}
Kostenlos starten →