EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Nightingale: A multimodal approach combining EEG signals and audio features to enhance music therapy

Zirui Chen, Nikhil Yadav iD

PLOS One · 2026

DOI: 10.1371/journal.pone.0341497 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS One, 2026. Verfasst von Zirui Chen und 1 weiteren Autor:innen. Beteiligte Einrichtung: The Webb Schools, Claremont, California, United States of America. Hauptthemen laut MEDLINE: Electroencephalography, Music Therapy, Emotions. Die Arbeit nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Music therapy has emerged as a promising, yet underutilized, treatment modality in various clinical settings. This paper presents Nightingale, a novel multimodal approach that integrates audio features with electroencephalogram (EEG) signals to predict a subject’s emotional response to music. The accuracy of emotional response predictions is enhanced using audio features coupled with EEG data extracted from the Dataset for Emotion Analysis using Physiological and Audiovisual Signals (DEAP). These combined modalities are used to develop a Multilayer Perceptron and Convolutional Neural Network architecture, achieving a Mean Absolute Percentage Error (MAPE) values of 19.52 for valence, 22.16 for arousal, and an R squared of 0.67 for the two domains. This approach offers superior performance to the most recent state-of-the-art in the field. Additionally, it requires significantly less computational resources and a simple network structure, providing an evidence-based prediction technique that could make music therapy more effective and accessible.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

ElectroencephalographyMusic TherapyEmotionsHumansConvolutional Neural NetworksMultilayer PerceptronsMusicSignal Processing, Computer-Assisted

Autor:innen und Institutionen

  • The Webb Schools, Claremont, California, United States of America.
  • Department of Computer Science, Shiley-Marcos School of Engineering, University of San Diego, San Diego, California, United States of America.

ORCID-Profile: Nikhil Yadav

Zitieren

APA

Chen, Z., & Yadav, N. (2026). Nightingale: A multimodal approach combining EEG signals and audio features to enhance music therapy. PLOS One. https://doi.org/10.1371/journal.pone.0341497

Vancouver

Chen Z, Yadav N. Nightingale: A multimodal approach combining EEG signals and audio features to enhance music therapy. PLOS One. 2026. doi:10.1371/journal.pone.0341497

BibTeX
@article{Chen2026,
  author = {Chen, Zirui and Yadav, Nikhil},
  title = {Nightingale: A multimodal approach combining EEG signals and audio features to enhance music therapy},
  journal = {PLOS One},
  year = {2026},
  doi = {10.1371/journal.pone.0341497}
}
Kostenlos starten →