Computing nasalance with MFCCs and Convolutional Neural Networks
PLOS ONE · 2024
DOI: 10.1371/journal.pone.0315452 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS ONE, 2024. Verfasst von Andrés Lozano und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Communication Engineering, University of Málaga, Málaga, Spain. Hauptthemen laut MEDLINE: Neural Networks, Computer. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministerio de Ciencia e Innovación.
Abstract (Originalsprache)
Nasalance is a valuable clinical biomarker for hypernasality. It is computed as the ratio of acoustic energy emitted through the nose to the total energy emitted through the mouth and nose ( eNasalance ). A new approach is proposed to compute nasalance using Convolutional Neural Networks (CNNs) trained with Mel-Frequency Cepstrum Coefficients ( mfccNasalance ). mfccNasalance is evaluated by examining its accuracy: 1) when the train and test data are from the same or from different dialects; 2) with test data that differs in dynamicity (e.g. rapidly produced diadochokinetic syllables versus short words); and 3) using multiple CNN configurations (i.e. kernel shape and use of 1 × 1 pointwise convolution). Dual-channel Nasometer speech data from healthy speakers from different dialects: Costa Rica, more(+) nasal, Spain and Chile, less(-) nasal, are recorded. The input to the CNN models were sequences of 39 MFCC vectors computed from 250 ms moving windows. The test data were recorded in Spain and included short words (-dynamic), sentences (+dynamic), and diadochokinetic syllables (+dynamic). The accuracy of a CNN model was defined as the Spearman correlation between the mfccNasalance for that model and the perceptual nasality scores of human experts. In the same-dialect condition, mfccNasalance was more accurate than eNasalance independently of the CNN configuration; using a 1 × 1 kernel resulted in increased accuracy for +dynamic utterances (p < .000), though not for -dynamic utterances. The kernel shape had a significant impact for -dynamic utterances (p < .000) exclusively. In the different-dialect condition, the scores were significantly less accurate than in the same-dialect condition, particularly for Costa Rica trained models. We conclude that mfccNasalance is a flexible and useful alternative to eNasalance . Future studies should explore how to optimize mfccNasalance by selecting the most adequate CNN model as a function of the dynamicity of the target speech data.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Communication Engineering, University of Málaga, Málaga, Spain.
- Department of Spanish Philology, University of Málaga, Málaga, Spain.
ORCID-Profile: Andrés Lozano, Enrique Nava
Förderung
- Ministerio de Ciencia e Innovación
Zitieren
APA
Lozano, A., Nava, E., García Méndez, M. D., & Moreno-Torres, I. (2024). Computing nasalance with MFCCs and Convolutional Neural Networks. PLOS ONE. https://doi.org/10.1371/journal.pone.0315452
Vancouver
Lozano A, Nava E, García Méndez MD, Moreno-Torres I. Computing nasalance with MFCCs and Convolutional Neural Networks. PLOS ONE. 2024. doi:10.1371/journal.pone.0315452
BibTeX
@article{Lozano2024,
author = {Lozano, Andrés and Nava, Enrique and García Méndez, María Dolores and Moreno-Torres, Ignacio},
title = {Computing nasalance with MFCCs and Convolutional Neural Networks},
journal = {PLOS ONE},
year = {2024},
doi = {10.1371/journal.pone.0315452}
}
EUVIMED