Performance of Paid and Volunteer Image Labeling in Citizen Science — A Retrospective Analysis
Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · 2022
DOI: 10.1609/hcomp.v10i1.21988 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, 2022. Verfasst von Kutub Gandhi und 4 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref).
Abstract (Originalsprache)
Citizen science projects that rely on human computation can attempt to solicit volunteers or use paid microwork platforms such as Amazon Mechanical Turk. To better understand these approaches, this paper analyzes crowdsourced image label data sourced from an environmental justice project looking at wetland loss off the coast of Louisiana. This retrospective analysis identifies key differences between the two populations: while Mechanical Turk workers are accessible, cost-efficient, and rate more images than volunteers (on average), their labels are of lower quality, whereas volunteers can achieve high accuracy with comparably few votes. Volunteer organizations can also interface with the educational or outreach goals of an organization in ways that the limited context of microwork prevents.
Zitieren
APA
Gandhi, K., Spatharioti, S. E., Eustis, S., Wylie, S., & Cooper, S. (2022). Performance of Paid and Volunteer Image Labeling in Citizen Science — A Retrospective Analysis. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing. https://doi.org/10.1609/hcomp.v10i1.21988
Vancouver
Gandhi K, Spatharioti SE, Eustis S, Wylie S, Cooper S. Performance of Paid and Volunteer Image Labeling in Citizen Science — A Retrospective Analysis. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing. 2022. doi:10.1609/hcomp.v10i1.21988
BibTeX
@article{Gandhi2022,
author = {Gandhi, Kutub and Spatharioti, Sofia Eleni and Eustis, Scott and Wylie, Sara and Cooper, Seth},
title = {Performance of Paid and Volunteer Image Labeling in Citizen Science — A Retrospective Analysis},
journal = {Proceedings of the AAAI Conference on Human Computation and Crowdsourcing},
year = {2022},
doi = {10.1609/hcomp.v10i1.21988}
}
EUVIMED