Using deep learning to improve the intelligibility of a target speaker in noisy multi-talker environments for people with normal hearing and hearing loss
The Journal of the Acoustical Society of America · 2024
DOI: 10.1121/10.0028007 ↗Kurz gefasst
Fachartikel in der Zeitschrift The Journal of the Acoustical Society of America, 2024. Verfasst von Iordanis Thoidis und 1 weiteren Autor:innen. Beteiligte Einrichtung: School of Electrical and Computer Engineering, Aristotle University of Thessaloniki, Thessaloniki 54124, Greece. Hauptthemen laut MEDLINE: Deep Learning, Speech Intelligibility, Noise, Speech Perception. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 117 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Medical Research Council UK, Medical Research Foundation.
Abstract (Originalsprache)
Understanding speech in noisy environments is a challenging task, especially in communication situations with several competing speakers. Despite their ongoing improvement, assistive listening devices and speech processing approaches still do not perform well enough in noisy multi-talker environments, as they may fail to restore the intelligibility of a speaker of interest among competing sound sources. In this study, a quasi-causal deep learning algorithm was developed that can extract the voice of a target speaker, as indicated by a short enrollment utterance, from a mixture of multiple concurrent speakers in background noise. Objective evaluation with computational metrics demonstrated that the speaker-informed algorithm successfully extracts the target speaker from noisy multi-talker mixtures. This was achieved using a single algorithm that generalized to unseen speakers, different numbers of speakers and relative speaker levels, and different speech corpora. Double-blind sentence recognition tests on mixtures of one, two, and three speakers in restaurant noise were conducted with listeners with normal hearing and listeners with hearing loss. Results indicated significant intelligibility improvements with the speaker-informed algorithm of 17% and 31% for people without and with hearing loss, respectively. In conclusion, it was demonstrated that deep learning-based speaker extraction can enhance speech intelligibility in noisy multi-talker environments where uninformed speech enhancement methods fail.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- School of Electrical and Computer Engineering, Aristotle University of Thessaloniki, Thessaloniki 54124, Greece.
- Cambridge Hearing Group, MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge CB2 7EF, United Kingdom.
ORCID-Profile: Iordanis Thoidis, Tobias Goehring
Förderung
- Medical Research Council UK
- Medical Research Foundation
Zitieren
APA
Thoidis, I., & Goehring, T. (2024). Using deep learning to improve the intelligibility of a target speaker in noisy multi-talker environments for people with normal hearing and hearing loss. The Journal of the Acoustical Society of America. https://doi.org/10.1121/10.0028007
Vancouver
Thoidis I, Goehring T. Using deep learning to improve the intelligibility of a target speaker in noisy multi-talker environments for people with normal hearing and hearing loss. The Journal of the Acoustical Society of America. 2024. doi:10.1121/10.0028007
BibTeX
@article{Thoidis2024,
author = {Thoidis, Iordanis and Goehring, Tobias},
title = {Using deep learning to improve the intelligibility of a target speaker in noisy multi-talker environments for people with normal hearing and hearing loss},
journal = {The Journal of the Acoustical Society of America},
year = {2024},
doi = {10.1121/10.0028007}
}
EUVIMED