The creative performance of the AI agents ChatGPT and Google Magenta compared to human-based solutions in a standardized melody continuation task
Jahrbuch Musikpsychologie · 2024
DOI: 10.5964/jbdgm.195 ↗Kurz gefasst
Fachartikel in der Zeitschrift Jahrbuch Musikpsychologie, 2024. Verfasst von Anton Schreiber und 3 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Many generative artificial intelligence (AI) systems have been developed over the last decade. Some systems are more of a generic character, and some are specialized in music composition. However, whether these AI systems are serious competitors for human composers remains unclear. Despite increased public interest, there is currently little empirical foundation for a conceivably equivalent performance for creative AI when compared to human experts in a controlled task. Thus, we conducted an online experiment to evaluate the subjectively perceived quality of AI compositions with human-made products (by music students) in a standardized task. Based on a melody continuation paradigm, creative products using AI were generated by the AI agents ChatGPT (Version 3.5) and Google Magenta Studio (Version 2.0). The human creative performances were realized by 57 melodic continuations, composed by music students. In the online evaluation study, listeners ( N = 71, mainly musicians) rated the aesthetic quality of the outcomes of the various systems. Additionally, the raters’ musical experience level was controlled as well as the length of the given melody completion task (two probe positions). As a main result, the overall quality of the AI compositions was rated significantly lower on all four target items compared to the human-made products (large effect sizes). Musical experience and the length of the melody did not influence the ratings. We conclude that the current capabilities of AI in the domain of musical creativity determined by a standardized composition task are far below human capabilities. However, we assume rapid progress will be made in the domain of generative music-specific AI systems.
Zitieren
APA
Schreiber, A., Sander, K., Kopiez, R., & Thöne, R. (2024). The creative performance of the AI agents ChatGPT and Google Magenta compared to human-based solutions in a standardized melody continuation task. Jahrbuch Musikpsychologie. https://doi.org/10.5964/jbdgm.195
Vancouver
Schreiber A, Sander K, Kopiez R, Thöne R. The creative performance of the AI agents ChatGPT and Google Magenta compared to human-based solutions in a standardized melody continuation task. Jahrbuch Musikpsychologie. 2024. doi:10.5964/jbdgm.195
BibTeX
@article{Schreiber2024,
author = {Schreiber, Anton and Sander, Kilian and Kopiez, Reinhard and Thöne, Raphael},
title = {The creative performance of the AI agents ChatGPT and Google Magenta compared to human-based solutions in a standardized melody continuation task},
journal = {Jahrbuch Musikpsychologie},
year = {2024},
doi = {10.5964/jbdgm.195}
}
EUVIMED