EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Hierarchical multi-head attention LSTM for polyphonic symbolic melody generation

Ahmet Kasif, Selcuk Sevgen, Alper Ozcan, Cagatay Catal

Multimedia Tools and Applications · 08.02.2024 · 83 (10) · 30297-30317

DOI: 10.1007/s11042-024-18491-7 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Multimedia Tools and Applications, online erschienen am 08.02.2024. Verfasst von Ahmet Kasif und 3 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Qatar University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Creating symbolic melodies with machine learning is challenging because it requires an understanding of musical structure and the handling of inter-dependencies and long-term dependencies. Learning the relationship between events that occur far apart in time in music poses a considerable challenge for machine learning models. Another notable feature of music is that notes must account for several inter-dependencies, including melodic, harmonic, and rhythmic aspects. Baseline methods, such as RNNs, LSTMs, and GRUs, often struggle to capture these dependencies, resulting in the generation of musically incoherent or repetitive melodies. As such, in this study, a hierarchical multi-head attention LSTM model is proposed for creating polyphonic symbolic melodies. This enables our model to generate more complex and expressive melodies than previous methods, while still being musically coherent. The model allows learning of long-term dependencies at different levels of abstraction, while retaining the ability to form inter-dependencies. The study has been conducted on two major symbolic music datasets, MAESTRO and Classical-Music MIDI, which feature musical content encoded on MIDI. The artistic nature of music poses a challenge to evaluating the generated content and qualitative analysis are often not enough. Thus, human listening tests are conducted to strengthen the evaluation. Qualitative analysis conducted on the generated melodies shows significantly improved loss scores on MSE over baseline methods, and is able to generate melodies that were both musically coherent and expressive. The listening tests conducted using Likert-scale support the qualitative results and provide better statistical scores over baseline methods.

Förderung

  • Qatar University

Zitieren

APA

Kasif, A., Sevgen, S., Ozcan, A., & Catal, C. (2024). Hierarchical multi-head attention LSTM for polyphonic symbolic melody generation. Multimedia Tools and Applications, 83(10), 30297-30317. https://doi.org/10.1007/s11042-024-18491-7

Vancouver

Kasif A, Sevgen S, Ozcan A, Catal C. Hierarchical multi-head attention LSTM for polyphonic symbolic melody generation. Multimedia Tools and Applications. 2024;83(10):30297-30317. doi:10.1007/s11042-024-18491-7

BibTeX
@article{Kasif2024,
  author = {Kasif, Ahmet and Sevgen, Selcuk and Ozcan, Alper and Catal, Cagatay},
  title = {Hierarchical multi-head attention LSTM for polyphonic symbolic melody generation},
  journal = {Multimedia Tools and Applications},
  year = {2024},
  volume = {83},
  number = {10},
  pages = {30297--30317},
  doi = {10.1007/s11042-024-18491-7}
}
Kostenlos starten →