EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Music-induced emotion flow modeling by ENMI Network

Yunrui Shang iD, Qi Peng, Zixuan Wu, Yinhua Liu iD

PLOS ONE · 21.10.2024 · 19 (10) · e0297712

DOI: 10.1371/journal.pone.0297712 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS ONE, online erschienen am 21.10.2024. Verfasst von Yunrui Shang und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Automation, Qingdao University, Qingdao, China. Hauptthemen laut MEDLINE: Music, Emotions. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Key Technologies Research and Development Program.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The relation between emotions and music is substantial because music as an art can evoke emotions. Music emotion recognition (MER) studies the emotions that music brings in the effort to map musical features to the affective dimensions. This study conceptualizes the mapping of music and emotion as a multivariate time series regression problem, with the aim of capturing the emotion flow in the Arousal-Valence emotional space. The Efficient Net-Music Informer (ENMI) Network was introduced to address this phenomenon. The ENMI was used to extract Mel-spectrogram features, complementing the time series data. Moreover, the Music Informer model was adopted to train on both time series music features and Mel-spectrogram features to predict emotional sequences. In our regression task, the model achieved a root mean square error (RMSE) of 0.0440 and 0.0352 in the arousal and valence dimensions, respectively, in the DEAM dataset. A comprehensive analysis of the effects of different hyperparameters tuning was conducted. Furthermore, different sequence lengths were predicted for the regression accuracy of the ENMI Network on three different datasets, namely the DEAM dataset, the Emomusic dataset, and the augmented Emomusic dataset. Additionally, a feature ablation on the Mel-spectrogram features and an analysis of the importance of the various musical features in the regression results were performed, establishing the effectiveness of the model presented herein.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

MusicEmotionsHumansArousalModels, Theoretical

Autor:innen und Institutionen

  • School of Automation, Qingdao University, Qingdao, China.
  • Institute for Future, Qingdao University, Qingdao, China.
  • Shandong Key Laboratory of Industrial Control Technology, Qingdao, China.

ORCID-Profile: Yunrui Shang, Yinhua Liu

Förderung

  • Key Technologies Research and Development Program

Zitieren

APA

Shang, Y., Peng, Q., Wu, Z., & Liu, Y. (2024). Music-induced emotion flow modeling by ENMI Network. PLOS ONE, 19(10), e0297712. https://doi.org/10.1371/journal.pone.0297712

Vancouver

Shang Y, Peng Q, Wu Z, Liu Y. Music-induced emotion flow modeling by ENMI Network. PLOS ONE. 2024;19(10):e0297712. doi:10.1371/journal.pone.0297712

BibTeX
@article{Shang2024,
  author = {Shang, Yunrui and Peng, Qi and Wu, Zixuan and Liu, Yinhua},
  title = {Music-induced emotion flow modeling by ENMI Network},
  journal = {PLOS ONE},
  year = {2024},
  volume = {19},
  number = {10},
  pages = {e0297712},
  doi = {10.1371/journal.pone.0297712}
}
Kostenlos starten →