Deformer: Denoising Transformer for Improved Audio Music Genre Classification
Applied Sciences · 25.11.2023 · 13 (23) · 12673
DOI: 10.3390/app132312673 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 25.11.2023. Verfasst von Jigang Wang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Education of the Republic of Korea and the National Research Foundation of Korea, Dongguk University Research Fund.
Abstract (Originalsprache)
Audio music genre classification is performed to categorize audio music into various genres. Traditional approaches based on convolutional recurrent neural networks do not consider long temporal information, and their sequential structures result in longer training times and convergence difficulties. To overcome these problems, a traditional transformer-based approach was introduced. However, this approach employs pre-training based on momentum contrast (MoCo), a technique that increases computational costs owing to its reliance on extracting many negative samples and its use of highly sensitive hyperparameters. Consequently, this complicates the training process and increases the risk of learning imbalances between positive and negative sample sets. In this paper, a method for audio music genre classification called Deformer is proposed. The Deformer learns deep representations of audio music data through a denoising process, eliminating the need for MoCo and additional hyperparameters, thus reducing computational costs. In the denoising process, it employs a prior decoder to reconstruct the audio patches, thereby enhancing the interpretability of the representations. By calculating the mean squared error loss between the reconstructed and real patches, Deformer can learn a more refined representation of the audio data. The performance of the proposed method was experimentally compared with that of two distinct baseline models: one based on S3T and one employing a residual neural network-bidirectional gated recurrent unit (ResNet-BiGRU). The Deformer achieved an 84.5% accuracy, surpassing both the ResNet-BiGRU-based (81%) and S3T-based (81.1%) models, highlighting its superior performance in audio classification.
Förderung
- Ministry of Education of the Republic of Korea and the National Research Foundation of Korea
- Dongguk University Research Fund
Zitieren
APA
Wang, J., Li, S., & Sung, Y. (2023). Deformer: Denoising Transformer for Improved Audio Music Genre Classification. Applied Sciences, 13(23), 12673. https://doi.org/10.3390/app132312673
Vancouver
Wang J, Li S, Sung Y. Deformer: Denoising Transformer for Improved Audio Music Genre Classification. Applied Sciences. 2023;13(23):12673. doi:10.3390/app132312673
BibTeX
@article{Wang2023,
author = {Wang, Jigang and Li, Shuyu and Sung, Yunsick},
title = {Deformer: Denoising Transformer for Improved Audio Music Genre Classification},
journal = {Applied Sciences},
year = {2023},
volume = {13},
number = {23},
pages = {12673},
doi = {10.3390/app132312673}
}
EUVIMED