EUVIMEDEUVIMED entdecken
ÜbersichtsarbeitOpen Access · CC BY 4.0

Automatic- and Transformer-Based Automatic Item Generation: A Critical Review

Markus Sommer, Martin Arendasy

Journal of Intelligence · 12.08.2025 · 13 (8) · 102

DOI: 10.3390/jintelligence13080102 ↗

Kurz gefasst

Übersichtsarbeit in der Zeitschrift Journal of Intelligence, online erschienen am 12.08.2025. Verfasst von Markus Sommer und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, University of Graz, Universitätsplatz 2, 8010 Graz, Austria. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 290 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: University of Graz.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This article provides a critical review of conceptually different approaches to automatic and transformer-based automatic item generation. Based on a discussion of the current challenges that have arisen due to changes in the use of psychometric tests in recent decades, we outline the requirements that these approaches should ideally fulfill. Subsequently, each approach is examined individually to determine the extent to which it can contribute to meeting the challenges. In doing so, we will focus on the cost savings during the actual item construction phase, the extent to which they may contribute to enhancing test validity, and potential cost savings in the item calibration phase due to either a reduction in the sample size required for item calibration or a reduction in the item loss due to insufficient psychometric characteristics. In addition, the article also aims to outline common recurring themes across these conceptually different approaches and outline areas within each approach that warrant further scientific research.

Schlagwörter

Stichwörter der Autor:innen

automatic item generationcomputerized adaptive testinglarge language modelslinear on-the-fly testingtest constructiontransformer-based automatic item generation

Autor:innen und Institutionen

  • Department of Psychology, University of Graz, Universitätsplatz 2, 8010 Graz, Austria.

Förderung

  • University of Graz

Zitieren

APA

Sommer, M., & Arendasy, M. (2025). Automatic- and Transformer-Based Automatic Item Generation: A Critical Review. Journal of Intelligence, 13(8), 102. https://doi.org/10.3390/jintelligence13080102

Vancouver

Sommer M, Arendasy M. Automatic- and Transformer-Based Automatic Item Generation: A Critical Review. Journal of Intelligence. 2025;13(8):102. doi:10.3390/jintelligence13080102

BibTeX
@article{Sommer2025,
  author = {Sommer, Markus and Arendasy, Martin},
  title = {Automatic- and Transformer-Based Automatic Item Generation: A Critical Review},
  journal = {Journal of Intelligence},
  year = {2025},
  volume = {13},
  number = {8},
  pages = {102},
  doi = {10.3390/jintelligence13080102}
}
Kostenlos starten →