Estimating the impact of local item dependency in a test of second language reading comprehension
Vocabulary Learning and Instruction · 2024
DOI: 10.29140/vli.v13n2.2126 ↗Kurz gefasst
Fachartikel in der Zeitschrift Vocabulary Learning and Instruction, 2024. Verfasst von Tim Stoeckel und 7 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Local item dependency (LID) occurs when test-takers’ responses to one test item are affected by their responses to another. It can be problematic if it causes inflated reliability estimates or distorted person and item measures. The cued-recall reading comprehension test in Hu and Nation’s (2000) well-known and influential coverage–comprehension study may have been susceptible to LID because of its very high sampling rate of idea units from the test’s reading passage. To explore this possibility, we examined Yen’s Q3 statistics in a dataset comprising responses from 63 learners who took Hu and Nation’s test. Using Q3 values of ≥ .30 to flag possible instances of LID, 14 item pairs were identified as being locally dependent. To remove LID, items with high Q3 values were combined into polytomous super-items. Using Rasch measurement, a comparison of the data with and without the effects of LID indicated that LID only modestly inflated reliability estimates and that there was a negligible effect on the ordering of persons by ability. Thus, while LID was present, it had only a small impact on how test scores might be interpreted in a study like Hu and Nation’s.
Zitieren
APA
Stoeckel, T., Tan, L. Y., Ha, H. T., Ho, N. T. P., Iishi, T., Kim, Y. A., Huang, C., & McLean, S. (2024). Estimating the impact of local item dependency in a test of second language reading comprehension. Vocabulary Learning and Instruction. https://doi.org/10.29140/vli.v13n2.2126
Vancouver
Stoeckel T, Tan LY, Ha HT, Ho NTP, Iishi T, Kim YA, et al. Estimating the impact of local item dependency in a test of second language reading comprehension. Vocabulary Learning and Instruction. 2024. doi:10.29140/vli.v13n2.2126
BibTeX
@article{Stoeckel2024,
author = {Stoeckel, Tim and Tan, Liang Ye and Ha, Hung Tan and Ho, Nam Thi Phuong and Iishi, Tomoko and Kim, Young Ae and Huang, Chunmei and McLean, Stuart},
title = {Estimating the impact of local item dependency in a test of second language reading comprehension},
journal = {Vocabulary Learning and Instruction},
year = {2024},
doi = {10.29140/vli.v13n2.2126}
}
EUVIMED