EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multi-Instance Multi-Scale Graph Attention Neural Net with Label Semantic Embeddings for Instrument Recognition

Na Bai, Zhaoli Wu, Jian Zhang

Signals · 24.06.2025 · 6 (3) · 30

DOI: 10.3390/signals6030030 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Signals, online erschienen am 24.06.2025. Verfasst von Na Bai und 2 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: General Project of Basic Science Research in Higher Education Institutions in Jiangsu Province, National Natural Science Foundations of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Instrument recognition is a crucial aspect of music information retrieval, and in recent years, machine learning-based methods have become the primary approach to addressing this challenge. However, existing models often struggle to accurately identify multiple instruments within music tracks that vary in length and quality. One key issue is that the instruments of interest may not appear in every clip of the audio sample, and when they do, they are often unevenly distributed across different sections of the track. Additionally, in polyphonic music, multiple instruments are often played simultaneously, leading to signal overlap. Using the same overlapping audio signals as partial classification features for different instruments will reduce the distinguishability of features between instruments, thereby affecting the performance of instrument recognition. These complexities present significant challenges for current instrument recognition models. Therefore, this paper proposes a multi-instance multi-scale graph attention neural network (MMGAT) with label semantic embeddings for instrument recognition. MMGAT designs an instance correlation graph to model the presence and quantitative timbre similarity of instruments at different positions from the perspective of multi-instance learning. Then, to enhance the distinguishability of signals after the overlap of different instruments and improve classification accuracy, MMGAT learns semantic information from the labels of different instruments as embeddings and incorporates them into the overlapping audio signal features, thereby enhancing the differentiability of audio features for various instruments. MMGAT then designs an instance-based multi-instance multi-scale graph attention neural network to recognize different instruments based on the instance correlation graphs and label semantic embeddings. The effectiveness of MMGAT is validated through experiments and compared to commonly used instrument recognition models. The experimental results demonstrate that MMGAT outperforms existing approaches in instrument recognition tasks.

Förderung

  • General Project of Basic Science Research in Higher Education Institutions in Jiangsu Province
  • National Natural Science Foundations of China

Zitieren

APA

Bai, N., Wu, Z., & Zhang, J. (2025). Multi-Instance Multi-Scale Graph Attention Neural Net with Label Semantic Embeddings for Instrument Recognition. Signals, 6(3), 30. https://doi.org/10.3390/signals6030030

Vancouver

Bai N, Wu Z, Zhang J. Multi-Instance Multi-Scale Graph Attention Neural Net with Label Semantic Embeddings for Instrument Recognition. Signals. 2025;6(3):30. doi:10.3390/signals6030030

BibTeX
@article{Bai2025,
  author = {Bai, Na and Wu, Zhaoli and Zhang, Jian},
  title = {Multi-Instance Multi-Scale Graph Attention Neural Net with Label Semantic Embeddings for Instrument Recognition},
  journal = {Signals},
  year = {2025},
  volume = {6},
  number = {3},
  pages = {30},
  doi = {10.3390/signals6030030}
}
Kostenlos starten →