EUVIMEDEUVIMED entdecken
Crossref

Speech intelligibility modeling using a pre-trained self-supervised model

Ann Bradlow, Eyal Cohen, Bronya R. Chernyak, Matthew Goldrick, Joseph Keshet, Seung-Eun Kim

The Journal of the Acoustical Society of America · 01.10.2025 · 158 (4_Supplement) · A260-A260

DOI: 10.1121/10.0040819 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Journal of the Acoustical Society of America, erschienen am 01.10.2025. Verfasst von Ann Bradlow und 5 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Phonetic theory generally assumes that speech is perceived in terms of acoustic cues, i.e., spectro-temporal properties that map onto discrete linguistic elements. Longer utterances are then presumed to be perceived compositionally, based on combined processing of acoustic cues associated with the sequence of linguistic elements that comprises the utterance. While traditional cue-based approaches have identified acoustic sources of talker-related intelligibility variation, a large portion of variation in both first-language (L1) and second-language (L2) speech intelligibility remains unexplained, especially for sentence-length utterances that involve multiple interacting acoustic dimensions and contextual dependencies. Self-supervised learning models, which are not restricted to purely compositional encoding, may provide novel insight into variation in intelligibility. We tested this by examining pre-trained self-supervised model representations of sentences produced by L1 (n = 25) versus L2 (n = 114) English talkers. We found that variation in intelligibility across L2 talkers is better explained by average distance from L1 talkers in the representational space than by traditional phonetic measures (e.g., vowel space, pitch variability, speech rate). This suggests that pre-trained self-supervised models hold substantial promise for breakthroughs in our understanding of the multitude of acoustic-phonetic dimensions that underlie speech variation and intelligibility. [Work supported by NSF DRL grant 2219843.]

Zitieren

APA

Bradlow, A., Cohen, E., Chernyak, B. R., Goldrick, M., Keshet, J., & Kim, S. (2025). Speech intelligibility modeling using a pre-trained self-supervised model. The Journal of the Acoustical Society of America, 158(4_Supplement), A260-A260. https://doi.org/10.1121/10.0040819

Vancouver

Bradlow A, Cohen E, Chernyak BR, Goldrick M, Keshet J, Kim S. Speech intelligibility modeling using a pre-trained self-supervised model. The Journal of the Acoustical Society of America. 2025;158(4_Supplement):A260-A260. doi:10.1121/10.0040819

BibTeX
@article{Bradlow2025,
  author = {Bradlow, Ann and Cohen, Eyal and Chernyak, Bronya R. and Goldrick, Matthew and Keshet, Joseph and Kim, Seung-Eun},
  title = {Speech intelligibility modeling using a pre-trained self-supervised model},
  journal = {The Journal of the Acoustical Society of America},
  year = {2025},
  volume = {158},
  number = {4_Supplement},
  pages = {A260--A260},
  doi = {10.1121/10.0040819}
}
Kostenlos starten →