EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

The creative performance of the AI agents ChatGPT and Google Magenta compared to human-based solutions in a standardized melody continuation task

Anton Schreiber, Kilian Sander, Reinhard Kopiez, Raphael Thöne

Jahrbuch Musikpsychologie · 2024

DOI: 10.5964/jbdgm.195 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Jahrbuch Musikpsychologie, 2024. Verfasst von Anton Schreiber und 3 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Many generative artificial intelligence (AI) systems have been developed over the last decade. Some systems are more of a generic character, and some are specialized in music composition. However, whether these AI systems are serious competitors for human composers remains unclear. Despite increased public interest, there is currently little empirical foundation for a conceivably equivalent performance for creative AI when compared to human experts in a controlled task. Thus, we conducted an online experiment to evaluate the subjectively perceived quality of AI compositions with human-made products (by music students) in a standardized task. Based on a melody continuation paradigm, creative products using AI were generated by the AI agents ChatGPT (Version 3.5) and Google Magenta Studio (Version 2.0). The human creative performances were realized by 57 melodic continuations, composed by music students. In the online evaluation study, listeners ( N = 71, mainly musicians) rated the aesthetic quality of the outcomes of the various systems. Additionally, the raters’ musical experience level was controlled as well as the length of the given melody completion task (two probe positions). As a main result, the overall quality of the AI compositions was rated significantly lower on all four target items compared to the human-made products (large effect sizes). Musical experience and the length of the melody did not influence the ratings. We conclude that the current capabilities of AI in the domain of musical creativity determined by a standardized composition task are far below human capabilities. However, we assume rapid progress will be made in the domain of generative music-specific AI systems.

Zitieren

APA

Schreiber, A., Sander, K., Kopiez, R., & Thöne, R. (2024). The creative performance of the AI agents ChatGPT and Google Magenta compared to human-based solutions in a standardized melody continuation task. Jahrbuch Musikpsychologie. https://doi.org/10.5964/jbdgm.195

Vancouver

Schreiber A, Sander K, Kopiez R, Thöne R. The creative performance of the AI agents ChatGPT and Google Magenta compared to human-based solutions in a standardized melody continuation task. Jahrbuch Musikpsychologie. 2024. doi:10.5964/jbdgm.195

BibTeX
@article{Schreiber2024,
  author = {Schreiber, Anton and Sander, Kilian and Kopiez, Reinhard and Thöne, Raphael},
  title = {The creative performance of the AI agents ChatGPT and Google Magenta compared to human-based solutions in a standardized melody continuation task},
  journal = {Jahrbuch Musikpsychologie},
  year = {2024},
  doi = {10.5964/jbdgm.195}
}
Kostenlos starten →