Examining Emotion Perception Agreement in Live Music Performance
IEEE Transactions on Affective Computing · 01.04.2023 · 14 (2) · 1442-1460
DOI: 10.1109/taffc.2021.3093787 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Affective Computing, erschienen am 01.04.2023. Verfasst von Simin Yang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 130 Literaturangaben. Gefördert von: China Scholarship Council, Electronic Engineering and Computer Science Principal Studentship from QMUL, EU ERC H2020 Advanced Fellowship.
Abstract (Originalsprache)
Current music emotion recognition (MER) systems rely on emotion data averaged across listeners and over time to infer the emotion expressed by a musical piece, often neglecting time- and listener-dependent factors. These limitations can restrict the efficacy of MER systems and cause misjudgements. We present two exploratory studies on music emotion perception. First, in a live music concert setting, fifteen audience members annotated perceived emotion in the valence-arousal space over time using a mobile application. Analyses of inter-rater reliability yielded widely varying levels of agreement in the perceived emotions. A follow-up lab-based study to uncover the reasons for such variability was conducted, where twenty-one participants annotated their perceived emotions whilst viewing and listening to a video recording of the original performance and offered open-ended explanations. Thematic analysis revealed salient features and interpretations that help describe the cognitive processes underlying music emotion perception. Some of the results confirm known findings of music perception and MER studies. Novel findings highlight the importance of less frequently discussed musical attributes, such as musical structure, performer expression, and stage setting, as perceived across audio and visual modalities. Musicians are found to attribute emotion change to musical harmony, structure, and performance technique more than non-musicians. We suggest that accounting for such listener-informed music features can benefit MER in helping to address variability in emotion perception by providing reasons for listener similarities and idiosyncrasies.
Förderung
- China Scholarship Council
- Electronic Engineering and Computer Science Principal Studentship from QMUL
- EU ERC H2020 Advanced Fellowship
Zitieren
APA
Yang, S., Reed, C. N., Chew, E., & Barthet, M. (2023). Examining Emotion Perception Agreement in Live Music Performance. IEEE Transactions on Affective Computing, 14(2), 1442-1460. https://doi.org/10.1109/taffc.2021.3093787
Vancouver
Yang S, Reed CN, Chew E, Barthet M. Examining Emotion Perception Agreement in Live Music Performance. IEEE Transactions on Affective Computing. 2023;14(2):1442-1460. doi:10.1109/taffc.2021.3093787
BibTeX
@article{Yang2023,
author = {Yang, Simin and Reed, Courtney N. and Chew, Elaine and Barthet, Mathieu},
title = {Examining Emotion Perception Agreement in Live Music Performance},
journal = {IEEE Transactions on Affective Computing},
year = {2023},
volume = {14},
number = {2},
pages = {1442--1460},
doi = {10.1109/taffc.2021.3093787}
}
EUVIMED