EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Deformer: Denoising Transformer for Improved Audio Music Genre Classification

Jigang Wang, Shuyu Li, Yunsick Sung

Applied Sciences · 25.11.2023 · 13 (23) · 12673

DOI: 10.3390/app132312673 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 25.11.2023. Verfasst von Jigang Wang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Education of the Republic of Korea and the National Research Foundation of Korea, Dongguk University Research Fund.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Audio music genre classification is performed to categorize audio music into various genres. Traditional approaches based on convolutional recurrent neural networks do not consider long temporal information, and their sequential structures result in longer training times and convergence difficulties. To overcome these problems, a traditional transformer-based approach was introduced. However, this approach employs pre-training based on momentum contrast (MoCo), a technique that increases computational costs owing to its reliance on extracting many negative samples and its use of highly sensitive hyperparameters. Consequently, this complicates the training process and increases the risk of learning imbalances between positive and negative sample sets. In this paper, a method for audio music genre classification called Deformer is proposed. The Deformer learns deep representations of audio music data through a denoising process, eliminating the need for MoCo and additional hyperparameters, thus reducing computational costs. In the denoising process, it employs a prior decoder to reconstruct the audio patches, thereby enhancing the interpretability of the representations. By calculating the mean squared error loss between the reconstructed and real patches, Deformer can learn a more refined representation of the audio data. The performance of the proposed method was experimentally compared with that of two distinct baseline models: one based on S3T and one employing a residual neural network-bidirectional gated recurrent unit (ResNet-BiGRU). The Deformer achieved an 84.5% accuracy, surpassing both the ResNet-BiGRU-based (81%) and S3T-based (81.1%) models, highlighting its superior performance in audio classification.

Förderung

  • Ministry of Education of the Republic of Korea and the National Research Foundation of Korea
  • Dongguk University Research Fund

Zitieren

APA

Wang, J., Li, S., & Sung, Y. (2023). Deformer: Denoising Transformer for Improved Audio Music Genre Classification. Applied Sciences, 13(23), 12673. https://doi.org/10.3390/app132312673

Vancouver

Wang J, Li S, Sung Y. Deformer: Denoising Transformer for Improved Audio Music Genre Classification. Applied Sciences. 2023;13(23):12673. doi:10.3390/app132312673

BibTeX
@article{Wang2023,
  author = {Wang, Jigang and Li, Shuyu and Sung, Yunsick},
  title = {Deformer: Denoising Transformer for Improved Audio Music Genre Classification},
  journal = {Applied Sciences},
  year = {2023},
  volume = {13},
  number = {23},
  pages = {12673},
  doi = {10.3390/app132312673}
}
Kostenlos starten →