Automatic- and Transformer-Based Automatic Item Generation: A Critical Review
Journal of Intelligence · 12.08.2025 · 13 (8) · 102
DOI: 10.3390/jintelligence13080102 ↗Kurz gefasst
Übersichtsarbeit in der Zeitschrift Journal of Intelligence, online erschienen am 12.08.2025. Verfasst von Markus Sommer und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, University of Graz, Universitätsplatz 2, 8010 Graz, Austria. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 290 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: University of Graz.
Abstract (Originalsprache)
This article provides a critical review of conceptually different approaches to automatic and transformer-based automatic item generation. Based on a discussion of the current challenges that have arisen due to changes in the use of psychometric tests in recent decades, we outline the requirements that these approaches should ideally fulfill. Subsequently, each approach is examined individually to determine the extent to which it can contribute to meeting the challenges. In doing so, we will focus on the cost savings during the actual item construction phase, the extent to which they may contribute to enhancing test validity, and potential cost savings in the item calibration phase due to either a reduction in the sample size required for item calibration or a reduction in the item loss due to insufficient psychometric characteristics. In addition, the article also aims to outline common recurring themes across these conceptually different approaches and outline areas within each approach that warrant further scientific research.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Psychology, University of Graz, Universitätsplatz 2, 8010 Graz, Austria.
Förderung
- University of Graz
Zitieren
APA
Sommer, M., & Arendasy, M. (2025). Automatic- and Transformer-Based Automatic Item Generation: A Critical Review. Journal of Intelligence, 13(8), 102. https://doi.org/10.3390/jintelligence13080102
Vancouver
Sommer M, Arendasy M. Automatic- and Transformer-Based Automatic Item Generation: A Critical Review. Journal of Intelligence. 2025;13(8):102. doi:10.3390/jintelligence13080102
BibTeX
@article{Sommer2025,
author = {Sommer, Markus and Arendasy, Martin},
title = {Automatic- and Transformer-Based Automatic Item Generation: A Critical Review},
journal = {Journal of Intelligence},
year = {2025},
volume = {13},
number = {8},
pages = {102},
doi = {10.3390/jintelligence13080102}
}
EUVIMED