Transformer-based Automatic Music Mood Classification Using Multi-modal Framework
Journal of Computer Science and Technology · 03.04.2023 · 23 (1) · e02
DOI: 10.24215/16666038.23.e02 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Computer Science and Technology, online erschienen am 03.04.2023. Verfasst von Sujeesha A. S und 1 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
The mood is a psychological state of feeling that is related to internal emotions and affect, which is how emotions are expressed outwardly. According to studies, music affects our moods, and we are also inclined to choose a theme based on our current moods. Audio-based techniques can achieve promising results, but lyrics also give relevant information about the moods of a song which may not be present in the audio part. So a multi-modal with both textual features and acoustic features can provide enhanced accuracy. Sequential networks such as long short-term memory networks (LSTM) and gated recurrent unit networks (GRU) are widely used in the most state-of-the-art natural language processing (NLP) models. A transformer model uses self-attention to compute representations of its inputs and outputs, unlike recurrent unit networks (RNNs) that use sequences and transformers that can parallelize over input positions during training. In this work, we proposed a multi-modal music mood classification system based on transformers and compared the system's performance using a bi-directional GRU (Bi-GRU)-based system with and without attention. The performance is also analyzed for other state-of-the-art approaches. The proposed transformer-based model acquired higher accuracy than the Bi-GRU-based multi-modal system withsingle-layer attention by providing a maximum accuracy of 77.94\%.
Zitieren
APA
S, S. A., & Rajan, R. (2023). Transformer-based Automatic Music Mood Classification Using Multi-modal Framework. Journal of Computer Science and Technology, 23(1), e02. https://doi.org/10.24215/16666038.23.e02
Vancouver
S SA, Rajan R. Transformer-based Automatic Music Mood Classification Using Multi-modal Framework. Journal of Computer Science and Technology. 2023;23(1):e02. doi:10.24215/16666038.23.e02
BibTeX
@article{S2023,
author = {S, Sujeesha A. and Rajan, Rajeev},
title = {Transformer-based Automatic Music Mood Classification Using Multi-modal Framework},
journal = {Journal of Computer Science and Technology},
year = {2023},
volume = {23},
number = {1},
pages = {e02},
doi = {10.24215/16666038.23.e02}
}
EUVIMED