EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Analysis of Voice, Speech, and Language Biomarkers of Parkinson’s Disease Collected in a Mixed Reality Setting

Milosz Dudek iD, Daria Hemmerling iD, Marta Kaczmarska iD, Joanna Stepien, Mateusz Daniol iD, Marek Wodzinski iD, Magdalena Wojcik-Pedziwiatr

Sensors · 10.04.2025 · 25 (8) · 2405

DOI: 10.3390/s25082405 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 10.04.2025. Verfasst von Milosz Dudek und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Measurement and Electronics, AGH University of Krakow, 30-059 Krakow, Poland. Hauptthemen laut MEDLINE: Parkinson Disease, Speech, Voice. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 56 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: The National Centre for Research and Development, Poland.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study explores an innovative approach to early Parkinson’s disease (PD) detection by analyzing speech data collected using a mixed reality (MR) system. A total of 57 Polish participants, including PD patients and healthy controls, performed five speech tasks while using an MR head-mounted display (HMD). Speech data were recorded and analyzed to extract acoustic and linguistic features, which were then evaluated using machine learning models, including logistic regression, support vector machines (SVMs), random forests, AdaBoost, and XGBoost. The XGBoost model achieved the best performance, with an F1-score of 0.90 ± 0.05 in the story-retelling task. Key features such as MFCCs (mel-frequency cepstral coefficients), spectral characteristics, RASTA-filtered auditory spectrum, and local shimmer were identified as significant in detecting PD-related speech alterations. Additionally, state-of-the-art deep learning models (wav2vec2, HuBERT, and WavLM) were fine-tuned for PD detection. HuBERT achieved the highest performance, with an F1-score of 0.94 ± 0.04 in the diadochokinetic task, demonstrating the potential of deep learning to capture complex speech patterns linked to neurodegenerative diseases. This study highlights the effectiveness of combining MR technology for speech data collection with advanced machine learning (ML) and deep learning (DL) techniques, offering a non-invasive and high-precision approach to PD diagnosis. The findings hold promise for broader clinical applications, advancing the diagnostic landscape for neurodegenerative disorders.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Parkinson DiseaseSpeechVoiceHumansFemaleMaleMiddle AgedBiomarkersAgedSupport Vector MachineMachine LearningLanguageDeep Learning

Stichwörter der Autor:innen

Parkinson’s diseaseexplainable artificial intelligencelarge language modelsmixed realityremote patient monitoringvoice biomarkers

Substanzen

Biomarkers

Autor:innen und Institutionen

  • Department of Measurement and Electronics, AGH University of Krakow, 30-059 Krakow, Poland.
  • Department of Neurology, Andrzej Frycz Modrzewski Krakow University, 30-705 Krakow, Poland.

ORCID-Profile: Milosz Dudek, Daria Hemmerling, Marta Kaczmarska, Mateusz Daniol, Marek Wodzinski

Förderung

  • The National Centre for Research and Development, Poland

Zitieren

APA

Dudek, M., Hemmerling, D., Kaczmarska, M., Stepien, J., Daniol, M., Wodzinski, M., & Wojcik-Pedziwiatr, M. (2025). Analysis of Voice, Speech, and Language Biomarkers of Parkinson’s Disease Collected in a Mixed Reality Setting. Sensors, 25(8), 2405. https://doi.org/10.3390/s25082405

Vancouver

Dudek M, Hemmerling D, Kaczmarska M, Stepien J, Daniol M, Wodzinski M, et al. Analysis of Voice, Speech, and Language Biomarkers of Parkinson’s Disease Collected in a Mixed Reality Setting. Sensors. 2025;25(8):2405. doi:10.3390/s25082405

BibTeX
@article{Dudek2025,
  author = {Dudek, Milosz and Hemmerling, Daria and Kaczmarska, Marta and Stepien, Joanna and Daniol, Mateusz and Wodzinski, Marek and Wojcik-Pedziwiatr, Magdalena},
  title = {Analysis of Voice, Speech, and Language Biomarkers of Parkinson’s Disease Collected in a Mixed Reality Setting},
  journal = {Sensors},
  year = {2025},
  volume = {25},
  number = {8},
  pages = {2405},
  doi = {10.3390/s25082405}
}
Kostenlos starten →