Handling Observations with Low Interrater Agreement Values
Journal of Analytical Sciences, Methods and Instrumentation · 2011
DOI: 10.4236/jasmi.2011.12002 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Analytical Sciences, Methods and Instrumentation, 2011. Verfasst von Gensheng Liu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Considerable research has been conducted on how interrater agreement (IRA) should be established before data can be aggregated from the individual rater level to the organization level in survey research. However, little is known about how researchers should treat the observations with low IRA values fail to meet the suggested standard. We seek to answer this question by investigating the impact of two factors (the relationship strength and the overall IRA level of a sample) on the IRA decision. Using both real data from a service industry and simulated data, we find that both factors affect whether a researcher should include or exclude observations with low IRA values. Based on the results, practical guidelines on when to use the entire sample are offered.
Zitieren
APA
Liu, G., Amini, M. M., Babakus, E., & Stafford, M. B. R. (2011). Handling Observations with Low Interrater Agreement Values. Journal of Analytical Sciences, Methods and Instrumentation. https://doi.org/10.4236/jasmi.2011.12002
Vancouver
Liu G, Amini MM, Babakus E, Stafford MBR. Handling Observations with Low Interrater Agreement Values. Journal of Analytical Sciences, Methods and Instrumentation. 2011. doi:10.4236/jasmi.2011.12002
BibTeX
@article{Liu2011,
author = {Liu, Gensheng and Amini, Mohammad M. and Babakus, Emin and Stafford, Marla B. Royne},
title = {Handling Observations with Low Interrater Agreement Values},
journal = {Journal of Analytical Sciences, Methods and Instrumentation},
year = {2011},
doi = {10.4236/jasmi.2011.12002}
}
EUVIMED