EUVIMEDEUVIMED entdecken
Crossref

Tragedy of the Commons in Crowd Work-Based Research

Huichuan Xia

ACM Journal on Responsible Computing · 2024

DOI: 10.1145/3626493 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Journal on Responsible Computing, 2024. Verfasst von Huichuan Xia. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 78 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Academic scholars have leveraged crowd work platforms such as MTurk to conduct research and collect data, but the data quality crisis in crowd work has been an alarming phenomenon recently. Though prior studies have discussed data quality and validity issues in crowd work via surveys and experiments, they kind of neglected to explore the scholars’ and particularly the IRB's ethical concerns and the related policies in various ethical guidelines for crowd work-based research in these respects. In this study, we interviewed 17 scholars from six disciplines and 15 IRB directors and analysts in the U.S. and analyzed 28 research guidance documents to fill these gaps. We identified common themes among our interviewees and documents but also discovered distinctive and even opposing views regarding the approval rate, rejection, and internal/external research validity. Based on the findings, we discussed a potential Tragedy of the Commons regarding data quality deterioration and the disciplinary differences regarding validity in crowd work-based research. We further explored the origin of the data quality and validity issues in crowd work-based research. We advocated the IRB's ethical concerns in crowd work-based research be heard and respected further and be reflected in the ethical guidance for crowd work-based research. Finally, we proposed our research implications, limits, and future work.

Zitieren

APA

Xia, H. (2024). Tragedy of the Commons in Crowd Work-Based Research. ACM Journal on Responsible Computing. https://doi.org/10.1145/3626493

Vancouver

Xia H. Tragedy of the Commons in Crowd Work-Based Research. ACM Journal on Responsible Computing. 2024. doi:10.1145/3626493

BibTeX
@article{Xia2024,
  author = {Xia, Huichuan},
  title = {Tragedy of the Commons in Crowd Work-Based Research},
  journal = {ACM Journal on Responsible Computing},
  year = {2024},
  doi = {10.1145/3626493}
}
Kostenlos starten →