EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Automated Scoring of Scientific Creativity in German

Benjamin Goecke, Paul V. DiStefano, Wolfgang Aschauer, Kurt Haim, Roger Beaty, Boris Forthmann

The Journal of Creative Behavior · 2024-09 · 58 (3) · 321-327

DOI: 10.1002/jocb.658 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Journal of Creative Behavior, online erschienen am 15.05.2024. Verfasst von Benjamin Goecke und 5 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Automated scoring is a current hot topic in creativity research. However, most research has focused on the English language and popular verbal creative thinking tasks, such as the alternate uses task. Therefore, in this study, we present a large language model approach for automated scoring of a scientific creative thinking task that assesses divergent ideation in experimental tasks in the German language. Participants are required to generate alternative explanations for an empirical observation. This work analyzed a total of 13,423 unique responses. To predict human ratings of originality, we used XLM‐RoBERTa (Cross‐lingual Language Model‐RoBERTa), a large, multilingual model. The prediction model was trained on 9,400 responses. Results showed a strong correlation between model predictions and human ratings in a held‐out test set ( n = 2,682; r = 0.80; CI‐95% [0.79, 0.81]). These promising findings underscore the potential of large language models for automated scoring of scientific creative thinking in the German language. We encourage researchers to further investigate automated scoring of other domain‐specific creative thinking tasks.

Zitieren

APA

Goecke, B., DiStefano, P. V., Aschauer, W., Haim, K., Beaty, R., & Forthmann, B. (2024). Automated Scoring of Scientific Creativity in German. The Journal of Creative Behavior, 58(3), 321-327. https://doi.org/10.1002/jocb.658

Vancouver

Goecke B, DiStefano PV, Aschauer W, Haim K, Beaty R, Forthmann B. Automated Scoring of Scientific Creativity in German. The Journal of Creative Behavior. 2024;58(3):321-327. doi:10.1002/jocb.658

BibTeX
@article{Goecke2024,
  author = {Goecke, Benjamin and DiStefano, Paul V. and Aschauer, Wolfgang and Haim, Kurt and Beaty, Roger and Forthmann, Boris},
  title = {Automated Scoring of Scientific Creativity in German},
  journal = {The Journal of Creative Behavior},
  year = {2024},
  volume = {58},
  number = {3},
  pages = {321--327},
  doi = {10.1002/jocb.658}
}
Kostenlos starten →