Using machine learning to model trace behavioral data from a game‐based assessment
International Journal of Selection and Assessment · 2022-03 · 30 (1) · 82-102
DOI: 10.1111/ijsa.12363 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Selection and Assessment, online erschienen am 14.12.2021. Verfasst von Elena M. Auer und 4 weiteren Autor:innen. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 73 Literaturangaben.
Abstract (Originalsprache)
In the context of game‐based assessments (GBAs), we examined the potential of trace data modeling to supplement or replace an existing GBA's scoring approach. We used data science tools and “big data” practices, such as feature engineering and a series of machine learning algorithms, to predict traditionally measured cognitive ability and conscientiousness scores from the copious trace data generated by a theory‐driven GBA designed to measure cognitive ability. Several types of predictors were developed from the raw trace data from 621 participants, including counts of game objects that the player interacted with, the amount of time spent doing so, and mouse movement data across a variety of meaningful intervals. Broadly, we found promising evidence for trace data modeling of cognitive ability, including incremental contribution to the prediction of a criterion grade point average (GPA), but less promising evidence for trace data modeling of conscientiousness, suggesting that trace data modeling like this may be more valuable for assessing traits in games that were developed to target those traits.
Zitieren
APA
Auer, E. M., Mersy, G., Marin, S., Blaik, J., & Landers, R. N. (2022). Using machine learning to model trace behavioral data from a game‐based assessment. International Journal of Selection and Assessment, 30(1), 82-102. https://doi.org/10.1111/ijsa.12363
Vancouver
Auer EM, Mersy G, Marin S, Blaik J, Landers RN. Using machine learning to model trace behavioral data from a game‐based assessment. International Journal of Selection and Assessment. 2022;30(1):82-102. doi:10.1111/ijsa.12363
BibTeX
@article{Auer2022,
author = {Auer, Elena M. and Mersy, Gabriel and Marin, Sebastian and Blaik, Jason and Landers, Richard N.},
title = {Using machine learning to model trace behavioral data from a game‐based assessment},
journal = {International Journal of Selection and Assessment},
year = {2022},
volume = {30},
number = {1},
pages = {82--102},
doi = {10.1111/ijsa.12363}
}
EUVIMED