Analysis of Log Data From an International Online Educational Assessment System: A Multi-State Survival Modeling Approach to Reaction Time Between and Across Action Sequence
Psychometrika · 2025
DOI: 10.1017/psy.2025.10043 ↗Kurz gefasst
Fachartikel in der Zeitschrift Psychometrika, 2025. Verfasst von Jina Park und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Applied Statistics, https://ror.org/01wjejq96Yonsei University, Seoul, South Korea. Hauptthemen laut MEDLINE: Educational Measurement, Reaction Time, Models, Statistical. Die Arbeit nennt 55 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Research Foundation of Korea.
Abstract (Originalsprache)
With increasingly available computer-based or online assessments, researchers have shown keen interest in analyzing log data to improve our understanding of test takers’ problem-solving processes. In this article, we propose a multi-state survival model (MSM) to action sequence data from log files, focusing on modeling test takers’ reaction times between actions, in order to investigate which factors and how they influence test takers’ transition speed between actions. We specifically identify the key actions that differentiate correct and incorrect answers, compare transition probabilities between these groups, and analyze their distinct problem-solving patterns. Through simulation studies and sensitivity analyses, we evaluate the robustness of our proposed model. We demonstrate the proposed approach using problem-solving items from the Programme for the International Assessment of Adult Competencies (PIAAC).
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Applied Statistics, https://ror.org/01wjejq96Yonsei University, Seoul, South Korea.
- Department of Statistics and Data Science, https://ror.org/01wjejq96Yonsei University, Seoul, South Korea.
- School of Education and Information Studies, https://ror.org/046rm7j60University of California, Los Angeles, CA, USA.
ORCID-Profile: Ick Hoon Jin
Förderung
- National Research Foundation of Korea
Zitieren
APA
Park, J., Jin, I. H., & Jeon, M. (2025). Analysis of Log Data From an International Online Educational Assessment System: A Multi-State Survival Modeling Approach to Reaction Time Between and Across Action Sequence. Psychometrika. https://doi.org/10.1017/psy.2025.10043
Vancouver
Park J, Jin IH, Jeon M. Analysis of Log Data From an International Online Educational Assessment System: A Multi-State Survival Modeling Approach to Reaction Time Between and Across Action Sequence. Psychometrika. 2025. doi:10.1017/psy.2025.10043
BibTeX
@article{Park2025,
author = {Park, Jina and Jin, Ick Hoon and Jeon, Minjeong},
title = {Analysis of Log Data From an International Online Educational Assessment System: A Multi-State Survival Modeling Approach to Reaction Time Between and Across Action Sequence},
journal = {Psychometrika},
year = {2025},
doi = {10.1017/psy.2025.10043}
}
EUVIMED