EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Using deep learning to improve the intelligibility of a target speaker in noisy multi-talker environments for people with normal hearing and hearing loss

Iordanis Thoidis iD, Tobias Goehring iD

The Journal of the Acoustical Society of America · 2024

DOI: 10.1121/10.0028007 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Journal of the Acoustical Society of America, 2024. Verfasst von Iordanis Thoidis und 1 weiteren Autor:innen. Beteiligte Einrichtung: School of Electrical and Computer Engineering, Aristotle University of Thessaloniki, Thessaloniki 54124, Greece. Hauptthemen laut MEDLINE: Deep Learning, Speech Intelligibility, Noise, Speech Perception. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 117 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Medical Research Council UK, Medical Research Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Understanding speech in noisy environments is a challenging task, especially in communication situations with several competing speakers. Despite their ongoing improvement, assistive listening devices and speech processing approaches still do not perform well enough in noisy multi-talker environments, as they may fail to restore the intelligibility of a speaker of interest among competing sound sources. In this study, a quasi-causal deep learning algorithm was developed that can extract the voice of a target speaker, as indicated by a short enrollment utterance, from a mixture of multiple concurrent speakers in background noise. Objective evaluation with computational metrics demonstrated that the speaker-informed algorithm successfully extracts the target speaker from noisy multi-talker mixtures. This was achieved using a single algorithm that generalized to unseen speakers, different numbers of speakers and relative speaker levels, and different speech corpora. Double-blind sentence recognition tests on mixtures of one, two, and three speakers in restaurant noise were conducted with listeners with normal hearing and listeners with hearing loss. Results indicated significant intelligibility improvements with the speaker-informed algorithm of 17% and 31% for people without and with hearing loss, respectively. In conclusion, it was demonstrated that deep learning-based speaker extraction can enhance speech intelligibility in noisy multi-talker environments where uninformed speech enhancement methods fail.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Deep LearningSpeech IntelligibilityNoiseSpeech PerceptionHumansFemaleMaleAdultMiddle AgedHearing LossYoung AdultAgedAlgorithmsHearingPerceptual Masking

Autor:innen und Institutionen

  • School of Electrical and Computer Engineering, Aristotle University of Thessaloniki, Thessaloniki 54124, Greece.
  • Cambridge Hearing Group, MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge CB2 7EF, United Kingdom.

ORCID-Profile: Iordanis Thoidis, Tobias Goehring

Förderung

  • Medical Research Council UK
  • Medical Research Foundation

Zitieren

APA

Thoidis, I., & Goehring, T. (2024). Using deep learning to improve the intelligibility of a target speaker in noisy multi-talker environments for people with normal hearing and hearing loss. The Journal of the Acoustical Society of America. https://doi.org/10.1121/10.0028007

Vancouver

Thoidis I, Goehring T. Using deep learning to improve the intelligibility of a target speaker in noisy multi-talker environments for people with normal hearing and hearing loss. The Journal of the Acoustical Society of America. 2024. doi:10.1121/10.0028007

BibTeX
@article{Thoidis2024,
  author = {Thoidis, Iordanis and Goehring, Tobias},
  title = {Using deep learning to improve the intelligibility of a target speaker in noisy multi-talker environments for people with normal hearing and hearing loss},
  journal = {The Journal of the Acoustical Society of America},
  year = {2024},
  doi = {10.1121/10.0028007}
}
Kostenlos starten →