Inter-rater reliability in Learner Corpus Research
International Journal of Learner Corpus Research · 10.12.2020 · 6 (2) · 237-251
DOI: 10.1075/ijlcr.20001.lar ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Learner Corpus Research, online erschienen am 10.12.2020. Verfasst von Tove Larsson und 2 weiteren Autor:innen. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
In Learner Corpus Research (LCR), a common source of errors stems from manual coding and annotation of linguistic features. To estimate the amount of error present in a coded dataset, coefficients of inter-rater reliability are used. However, despite the importance of reliability and internal consistency for validity and, by extension, study quality, interpretability and generalizability, it is surprisingly uncommon for studies in the field of LCR to report on such reliability coefficients. In this Methods Report, we use a recent collaborative research project to illustrate the pertinence of considering inter-rater reliability. In doing so, we hope to initiate methodological discussion on instrument design, piloting and evaluation. We also suggest some ways forward to encourage increased transparency in reporting practices.
Zitieren
APA
Larsson, T., Paquot, M., & Plonsky, L. (2020). Inter-rater reliability in Learner Corpus Research. International Journal of Learner Corpus Research, 6(2), 237-251. https://doi.org/10.1075/ijlcr.20001.lar
Vancouver
Larsson T, Paquot M, Plonsky L. Inter-rater reliability in Learner Corpus Research. International Journal of Learner Corpus Research. 2020;6(2):237-251. doi:10.1075/ijlcr.20001.lar
BibTeX
@article{Larsson2020,
author = {Larsson, Tove and Paquot, Magali and Plonsky, Luke},
title = {Inter-rater reliability in Learner Corpus Research},
journal = {International Journal of Learner Corpus Research},
year = {2020},
volume = {6},
number = {2},
pages = {237--251},
doi = {10.1075/ijlcr.20001.lar}
}
EUVIMED