EUVIMEDEUVIMED entdecken
Crossref

Analytic rubric scoring versus comparative judgment: a comparison of two approaches to assessing spoken-language interpreting

Chao Han

Meta · 02.11.2021 · 66 (2) · 337-361

DOI: 10.7202/1083182ar ↗

Kurz gefasst

Fachartikel in der Zeitschrift Meta, online erschienen am 02.11.2021. Verfasst von Chao Han. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 37 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In this article, we report on an empirical study conducted to evaluate the utility of analytic rubric scoring (ARS) vis-à-vis comparative judgment (CJ) as two approaches to assessing spoken-language interpreting. The primary motivation behind the study is that the potential advantages of CJ may make it a promising alternative to ARS. When conducting CJ on interpreting, judges need to compare two renditions and decide which one is of higher quality. Such binary decisions are then modeled statistically to produce a scaled rank order of the renditions from “worst” to “best.” We set up an experiment in which two groups of raters/judges of varying scoring expertise applied both CJ and ARS to assess 40 samples of English-Chinese consecutive interpreting. Our analysis of quantitative data suggests that overall ARS outperformed CJ in terms of validity, reliability, practicality and acceptability. Qualitative questionnaire data helped us obtain insights into the judges’/raters’ perceived advantages and disadvantages of CJ and ARS. Based on the findings, we tried to account for CJ’s underperformance vis-à-vis ARS, focusing on the specificities of interpreting assessment. We also propose potential avenues for future research to improve our understanding of interpreting assessment.

Zitieren

APA

Han, C. (2021). Analytic rubric scoring versus comparative judgment: a comparison of two approaches to assessing spoken-language interpreting. Meta, 66(2), 337-361. https://doi.org/10.7202/1083182ar

Vancouver

Han C. Analytic rubric scoring versus comparative judgment: a comparison of two approaches to assessing spoken-language interpreting. Meta. 2021;66(2):337-361. doi:10.7202/1083182ar

BibTeX
@article{Han2021,
  author = {Han, Chao},
  title = {Analytic rubric scoring versus comparative judgment: a comparison of two approaches to assessing spoken-language interpreting},
  journal = {Meta},
  year = {2021},
  volume = {66},
  number = {2},
  pages = {337--361},
  doi = {10.7202/1083182ar}
}
Kostenlos starten →