Nightingale: A multimodal approach combining EEG signals and audio features to enhance music therapy
PLOS One · 2026
DOI: 10.1371/journal.pone.0341497 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS One, 2026. Verfasst von Zirui Chen und 1 weiteren Autor:innen. Beteiligte Einrichtung: The Webb Schools, Claremont, California, United States of America. Hauptthemen laut MEDLINE: Electroencephalography, Music Therapy, Emotions. Die Arbeit nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Music therapy has emerged as a promising, yet underutilized, treatment modality in various clinical settings. This paper presents Nightingale, a novel multimodal approach that integrates audio features with electroencephalogram (EEG) signals to predict a subject’s emotional response to music. The accuracy of emotional response predictions is enhanced using audio features coupled with EEG data extracted from the Dataset for Emotion Analysis using Physiological and Audiovisual Signals (DEAP). These combined modalities are used to develop a Multilayer Perceptron and Convolutional Neural Network architecture, achieving a Mean Absolute Percentage Error (MAPE) values of 19.52 for valence, 22.16 for arousal, and an R squared of 0.67 for the two domains. This approach offers superior performance to the most recent state-of-the-art in the field. Additionally, it requires significantly less computational resources and a simple network structure, providing an evidence-based prediction technique that could make music therapy more effective and accessible.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- The Webb Schools, Claremont, California, United States of America.
- Department of Computer Science, Shiley-Marcos School of Engineering, University of San Diego, San Diego, California, United States of America.
ORCID-Profile: Nikhil Yadav
Zitieren
APA
Chen, Z., & Yadav, N. (2026). Nightingale: A multimodal approach combining EEG signals and audio features to enhance music therapy. PLOS One. https://doi.org/10.1371/journal.pone.0341497
Vancouver
Chen Z, Yadav N. Nightingale: A multimodal approach combining EEG signals and audio features to enhance music therapy. PLOS One. 2026. doi:10.1371/journal.pone.0341497
BibTeX
@article{Chen2026,
author = {Chen, Zirui and Yadav, Nikhil},
title = {Nightingale: A multimodal approach combining EEG signals and audio features to enhance music therapy},
journal = {PLOS One},
year = {2026},
doi = {10.1371/journal.pone.0341497}
}
EUVIMED