Cross-Lingual Transferability of Voice Analysis Models: a Parkinson’s Disease Case Study
Book series Studi AISV · 01.01.2023
DOI: 10.17469/o2111aisv000007 ↗Kurz gefasst
Fachartikel in der Zeitschrift Book series Studi AISV, erschienen am 01.01.2023. Verfasst von Ferrante und 3 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref).
Abstract (Originalsprache)
Traditionally, speech analysis has always relied on a set of very informative features like (Mel) spectrogram, Mel Frequency Cepstral Coefficients (MFCC), pitch or intensity to build speech powered applications. Recently, deep learning-based models for the extraction of acoustic features have allowed significantly improving the state of the art in many speech-related applications. With this work, we focus the analysis on the cross-lingual transferability of speech analysis features. The idea is to understand whether and how well a classification model trained on speech features in a source language works on an unseen target language. We evaluate these properties analysing models for Parkinson's disease detection from speech, adapting the models from English to Telugu. Results show that multi-lingual pre-trained deep learning-based features do not require explicit adaptation and work well out-of-the-box. Differently, models not adapting out-of-the-box respond well even to unsupervised adaptation on a small data set.
Schlagwörter
Zitieren
APA
Ferrante, Claudio, Scotti, & Vincenzo (2023). Cross-Lingual Transferability of Voice Analysis Models: a Parkinson’s Disease Case Study. Book series Studi AISV. https://doi.org/10.17469/o2111aisv000007
Vancouver
Ferrante, Claudio, Scotti, Vincenzo. Cross-Lingual Transferability of Voice Analysis Models: a Parkinson’s Disease Case Study. Book series Studi AISV. 2023. doi:10.17469/o2111aisv000007
BibTeX
@article{Ferrante2023,
author = {Ferrante and Claudio and Scotti and Vincenzo},
title = {Cross-Lingual Transferability of Voice Analysis Models: a Parkinson’s Disease Case Study},
journal = {Book series Studi AISV},
year = {2023},
doi = {10.17469/o2111aisv000007}
}
EUVIMED