EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Topic Testlet Model for Calibrating Testlet Constructed Responses

Jiawei Xiong, Huan (Hailey) Kuang, Cheng Tang, Qidi Liu, Bowen Wang, George Engelhard, Allan S. Cohen, Xinhui (Maggie) Xiong, Rufei Sheng

Journal of Educational Measurement · 2026-03 · 63 (1)

DOI: 10.1111/jedm.70001 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Educational Measurement, online erschienen am 07.08.2025. Verfasst von Jiawei Xiong und 8 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Constructed responses (CRs) within testlets are widely used to assess complex skills but can pose calibration challenges due to local item dependence. A few current testlet models incorporate testlet‐specific effects to address local dependence but struggle with interpreting these effects and may not fully capture the complexities of CR items because they rely only on response or score patterns. A Topic Testlet Model (TTM) integrates topic modeling within a psychometric framework was proposed. It uses latent topics from student written responses to adjust for local dependence, enable simultaneous calibration, and provide insights into evaluating student reasoning and writing in testlet CR items. Using empirical data from both English Language and Arts as well as Science assessments for grades 3‐12, we compare the TTM with existing models in terms of ability estimates, item parameter estimates, and overall model fit. Simulation studies further demonstrate parameter recovery under various testing scenarios. Results show that the TTM effectively accounts for local dependence, improves testlet effect interpretability, and demonstrates a better fit than the existing models. TTM advances CR testlet calibration, leveraging additional information from student written responses to improve the precision of the assessment systems and validity of the use of test scores.

Zitieren

APA

Xiong, J., Kuang, H. H., Tang, C., Liu, Q., Wang, B., Engelhard, G., Cohen, A. S., Xiong, X. M., & Sheng, R. (2026). A Topic Testlet Model for Calibrating Testlet Constructed Responses. Journal of Educational Measurement, 63(1). https://doi.org/10.1111/jedm.70001

Vancouver

Xiong J, Kuang HH, Tang C, Liu Q, Wang B, Engelhard G, et al. A Topic Testlet Model for Calibrating Testlet Constructed Responses. Journal of Educational Measurement. 2026;63(1). doi:10.1111/jedm.70001

BibTeX
@article{Xiong2026,
  author = {Xiong, Jiawei and Kuang, Huan (Hailey) and Tang, Cheng and Liu, Qidi and Wang, Bowen and Engelhard, George and Cohen, Allan S. and Xiong, Xinhui (Maggie) and Sheng, Rufei},
  title = {A Topic Testlet Model for Calibrating Testlet Constructed Responses},
  journal = {Journal of Educational Measurement},
  year = {2026},
  volume = {63},
  number = {1},
  doi = {10.1111/jedm.70001}
}
Kostenlos starten →