EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Estimating the impact of local item dependency in a test of second language reading comprehension

Tim Stoeckel, Liang Ye Tan, Hung Tan Ha, Nam Thi Phuong Ho, Tomoko Iishi, Young Ae Kim, Chunmei Huang, Stuart McLean

Vocabulary Learning and Instruction · 2024

DOI: 10.29140/vli.v13n2.2126 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Vocabulary Learning and Instruction, 2024. Verfasst von Tim Stoeckel und 7 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Local item dependency (LID) occurs when test-takers’ responses to one test item are affected by their responses to another. It can be problematic if it causes inflated reliability estimates or distorted person and item measures. The cued-recall reading comprehension test in Hu and Nation’s (2000) well-known and influential coverage–comprehension study may have been susceptible to LID because of its very high sampling rate of idea units from the test’s reading passage. To explore this possibility, we examined Yen’s Q3 statistics in a dataset comprising responses from 63 learners who took Hu and Nation’s test. Using Q3 values of ≥ .30 to flag possible instances of LID, 14 item pairs were identified as being locally dependent. To remove LID, items with high Q3 values were combined into polytomous super-items. Using Rasch measurement, a comparison of the data with and without the effects of LID indicated that LID only modestly inflated reliability estimates and that there was a negligible effect on the ordering of persons by ability. Thus, while LID was present, it had only a small impact on how test scores might be interpreted in a study like Hu and Nation’s.

Zitieren

APA

Stoeckel, T., Tan, L. Y., Ha, H. T., Ho, N. T. P., Iishi, T., Kim, Y. A., Huang, C., & McLean, S. (2024). Estimating the impact of local item dependency in a test of second language reading comprehension. Vocabulary Learning and Instruction. https://doi.org/10.29140/vli.v13n2.2126

Vancouver

Stoeckel T, Tan LY, Ha HT, Ho NTP, Iishi T, Kim YA, et al. Estimating the impact of local item dependency in a test of second language reading comprehension. Vocabulary Learning and Instruction. 2024. doi:10.29140/vli.v13n2.2126

BibTeX
@article{Stoeckel2024,
  author = {Stoeckel, Tim and Tan, Liang Ye and Ha, Hung Tan and Ho, Nam Thi Phuong and Iishi, Tomoko and Kim, Young Ae and Huang, Chunmei and McLean, Stuart},
  title = {Estimating the impact of local item dependency in a test of second language reading comprehension},
  journal = {Vocabulary Learning and Instruction},
  year = {2024},
  doi = {10.29140/vli.v13n2.2126}
}
Kostenlos starten →