Addressing fraudulent responses in online surveys: Insights from a web‐based participatory mapping study
People and Nature · 2024-02 · 6 (1) · 147-164
DOI: 10.1002/pan3.10557 ↗Kurz gefasst
Fachartikel in der Zeitschrift People and Nature, online erschienen am 12.11.2023. Verfasst von Malcolm S. Johnson und 2 weiteren Autor:innen. Die Arbeit wurde bisher 61-mal zitiert (Crossref) und nennt 93 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Web‐based studies of human dimensions are increasing across environmental and socio‐ecological disciplines. However, the prevalence of fraud threatens research quality. Increased fraud rates should be expected as surveys move progressively more online, motivated by expanding reach, cost savings and/or in response to COVID‐19. Web‐based research must better account for fraud to maintain confidence in findings. Practical diagnostic tools and data quality protocols are required to detect fraud and ensure results quality. Drawing on our experience using an online participatory mapping case study, we discuss methods to detect potentially fraudulent responses—and identify some limitations. We begin by reviewing the current state of knowledge on fraudulent responses or ‘fraudsters’ and its relative absence in environmental and socio‐ecological disciplines. We then describe our research approach, the indicators and variables we used to detect and assess fraud and our decision‐making process to eliminate suspicious responses without jeopardizing research integrity. We found that despite several preventative measures, many fraudulent respondents could provide survey responses and effectively mimicked legitimate respondents at first glance. By assuming each response to be ‘potentially fraudulent’, we determined that the complete screening of each respondent, while time‐consuming, can limit the prevalence of fraud. We also determined that the most common data consistency checks (e.g. duration, trap questions and straight‐liner checks) are unlikely to guarantee valid respondents. If not acknowledged and addressed, fraud has the potential to undermine data integrity, discredit research findings and limit the utility of results for policy. This study contributes to environmental and socio‐ecological research by reviewing existing fraudster literature and using our experience with fraud to provide recommendations for researchers to address this problem. We encourage researchers implementing online qualitative research methods to thoroughly assess and report fraud, when possible, to ensure widespread knowledge of this growing threat. Read the free Plain Language Summary for this article on the Journal blog.
Zitieren
APA
Johnson, M. S., Adams, V. M., & Byrne, J. (2024). Addressing fraudulent responses in online surveys: Insights from a web‐based participatory mapping study. People and Nature, 6(1), 147-164. https://doi.org/10.1002/pan3.10557
Vancouver
Johnson MS, Adams VM, Byrne J. Addressing fraudulent responses in online surveys: Insights from a web‐based participatory mapping study. People and Nature. 2024;6(1):147-164. doi:10.1002/pan3.10557
BibTeX
@article{Johnson2024,
author = {Johnson, Malcolm S. and Adams, Vanessa M. and Byrne, Jason},
title = {Addressing fraudulent responses in online surveys: Insights from a web‐based participatory mapping study},
journal = {People and Nature},
year = {2024},
volume = {6},
number = {1},
pages = {147--164},
doi = {10.1002/pan3.10557}
}
EUVIMED