EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Analysis of Log Data From an International Online Educational Assessment System: A Multi-State Survival Modeling Approach to Reaction Time Between and Across Action Sequence

Jina Park, Ick Hoon Jin iD, Minjeong Jeon

Psychometrika · 2025

DOI: 10.1017/psy.2025.10043 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Psychometrika, 2025. Verfasst von Jina Park und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Applied Statistics, https://ror.org/01wjejq96Yonsei University, Seoul, South Korea. Hauptthemen laut MEDLINE: Educational Measurement, Reaction Time, Models, Statistical. Die Arbeit nennt 55 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Research Foundation of Korea.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With increasingly available computer-based or online assessments, researchers have shown keen interest in analyzing log data to improve our understanding of test takers’ problem-solving processes. In this article, we propose a multi-state survival model (MSM) to action sequence data from log files, focusing on modeling test takers’ reaction times between actions, in order to investigate which factors and how they influence test takers’ transition speed between actions. We specifically identify the key actions that differentiate correct and incorrect answers, compare transition probabilities between these groups, and analyze their distinct problem-solving patterns. Through simulation studies and sensitivity analyses, we evaluate the robustness of our proposed model. We demonstrate the proposed approach using problem-solving items from the Programme for the International Assessment of Adult Competencies (PIAAC).

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Educational MeasurementReaction TimeModels, StatisticalHumansProblem SolvingPsychometrics

Stichwörter der Autor:innen

key actionslog datamulti-state survival modelproblem-solving testreaction time

Autor:innen und Institutionen

  • Department of Applied Statistics, https://ror.org/01wjejq96Yonsei University, Seoul, South Korea.
  • Department of Statistics and Data Science, https://ror.org/01wjejq96Yonsei University, Seoul, South Korea.
  • School of Education and Information Studies, https://ror.org/046rm7j60University of California, Los Angeles, CA, USA.

ORCID-Profile: Ick Hoon Jin

Förderung

  • National Research Foundation of Korea

Zitieren

APA

Park, J., Jin, I. H., & Jeon, M. (2025). Analysis of Log Data From an International Online Educational Assessment System: A Multi-State Survival Modeling Approach to Reaction Time Between and Across Action Sequence. Psychometrika. https://doi.org/10.1017/psy.2025.10043

Vancouver

Park J, Jin IH, Jeon M. Analysis of Log Data From an International Online Educational Assessment System: A Multi-State Survival Modeling Approach to Reaction Time Between and Across Action Sequence. Psychometrika. 2025. doi:10.1017/psy.2025.10043

BibTeX
@article{Park2025,
  author = {Park, Jina and Jin, Ick Hoon and Jeon, Minjeong},
  title = {Analysis of Log Data From an International Online Educational Assessment System: A Multi-State Survival Modeling Approach to Reaction Time Between and Across Action Sequence},
  journal = {Psychometrika},
  year = {2025},
  doi = {10.1017/psy.2025.10043}
}
Kostenlos starten →