EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Duration versus accuracy—what matters for computerised adaptive testing in schools?

Nikola Ebenbeck, Morten Bastian, Andreas Mühling, Markus Gebhardt

Journal of Computer Assisted Learning · 2024-12 · 40 (6) · 3443-3453

DOI: 10.1111/jcal.13074 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Computer Assisted Learning, online erschienen am 06.10.2024. Verfasst von Nikola Ebenbeck und 3 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 64 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Bundesministerium für Bildung und Forschung.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Computerised adaptive tests (CATs) are tests that provide personalised, efficient and accurate measurement while reducing testing time, depending on the desired level of precision. Schools have different types of assessments that can benefit from a significant reduction in testing time to varying degrees, depending on the area of application, but for which the loss of measurement accuracy has a different impact. The implementation of CAT can take several approaches, each of which can potentially affect the resulting test length and accuracy.

Objectives

We compare the methods of estimation‐based CAT and binary‐search‐based CAT to determine the extent to which they are suitable for school assessment in terms of their length and accuracy.

Methods

This study uses simulations based on empirical data from a cohort of pupils with and without special needs ( n = 400) to examine the effects of probabilistic estimation‐based CAT and deterministic binary‐search‐based CAT on the length and accuracy of an adaptive reading test for pupils with different ability levels. Results and Conclusions Estimation‐based CAT leads to a 40% test reduction with an average accuracy of r = 0.96, while binary‐search‐based CAT leads to a test reduction of up to 88% with an average accuracy of r = 0.83. Both methods demonstrate the applicability of CAT in educational environments. Practical advantages and disadvantages of both methods for learning environments are discussed, as well as which method is best suited for specific assessment needs.

Förderung

  • Bundesministerium für Bildung und Forschung

Zitieren

APA

Ebenbeck, N., Bastian, M., Mühling, A., & Gebhardt, M. (2024). Duration versus accuracy—what matters for computerised adaptive testing in schools?. Journal of Computer Assisted Learning, 40(6), 3443-3453. https://doi.org/10.1111/jcal.13074

Vancouver

Ebenbeck N, Bastian M, Mühling A, Gebhardt M. Duration versus accuracy—what matters for computerised adaptive testing in schools?. Journal of Computer Assisted Learning. 2024;40(6):3443-3453. doi:10.1111/jcal.13074

BibTeX
@article{Ebenbeck2024,
  author = {Ebenbeck, Nikola and Bastian, Morten and Mühling, Andreas and Gebhardt, Markus},
  title = {Duration versus accuracy—what matters for computerised adaptive testing in schools?},
  journal = {Journal of Computer Assisted Learning},
  year = {2024},
  volume = {40},
  number = {6},
  pages = {3443--3453},
  doi = {10.1111/jcal.13074}
}
Kostenlos starten →