Imposters, Bots, and Other Threats to Data Integrity in Online Research: Scoping Review of the Literature and Recommendations for Best Practices
Online Journal of Public Health Informatics · 2025-08-29 · 17 · e70926-e70926
DOI: 10.2196/70926 ↗At a glance
Übersichtsarbeit in Online Journal of Public Health Informatics, published online on 2025-08-29. Written by Isabella B Strickland and 6 co-authors. Institution: College of Public Health, The Ohio State University, 1841 Neil Ave, Columbus, OH, 43210, United States, 1 6142924647. Cited 14 times so far (Crossref); 103 references. The full text is freely available in PubMed Central. Funded by: NCI NIH HHS.
Abstract (original language)
Background
Threats to data integrity have always existed in online human subjects research, but it appears these threats have become more common and more advanced in recent years. Researchers have proposed various techniques to address satisficers, repeat participants, bots, and fraudulent participants; yet, no synthesis of this literature has been conducted.
Objective
This study undertakes a scoping review of recent methods and ethical considerations for addressing threats to data integrity in online research.
Methods
A PubMed search was used to identify 90 articles published from 2020 to 2024 that were written in English, that discussed online human subjects research, and that had at least one paragraph dedicated to discussing threats to online data integrity.
Results
We cataloged 16 types of techniques for addressing threats to online data integrity. Techniques to authenticate personal information (eg, videoconferencing and mailing incentives to a physical address) appear to be very effective at deterring or identifying fraudulent participants. Yet such techniques also come with ethical considerations, including participant burden and increased threats to privacy. Other techniques, such as Completely Automated Public Turing test to tell Computers and Humans Apart (reCAPTCHA; Google LLC), scores, and checking IP addresses, although very common, were also deemed by several researchers as no longer sufficient protections against advanced threats to data integrity.
Conclusions
Overall, this review demonstrates the importance of shifting online research protocols as bots and fraudulent participants become more sophisticated.
Subjects
Author keywords
Authors and institutions
- College of Public Health, The Ohio State University, 1841 Neil Ave, Columbus, OH, 43210, United States, 1 6142924647.
- Center for Tobacco Research, The Ohio State University Comprehensive Cancer Center, The Ohio State University, Columbus, OH, United States.
- Division of Medical Oncology, Department of Internal Medicine, College of Medicine, The Ohio State University, Columbus, OH, United States.
- Psychiatry and Behavioral Health, College of Medicine, The Ohio State University, Columbus, OH, United States.
Funding
- NCI NIH HHS
Cite
APA
Strickland, I. B., Ferketich, A. K., Tackett, A. P., Patterson, J. G., Breitborde, N. J. K., Davis, J., & Roberts, M. (2025). Imposters, Bots, and Other Threats to Data Integrity in Online Research: Scoping Review of the Literature and Recommendations for Best Practices. Online Journal of Public Health Informatics, 17, e70926-e70926. https://doi.org/10.2196/70926
Vancouver
Strickland IB, Ferketich AK, Tackett AP, Patterson JG, Breitborde NJK, Davis J, et al. Imposters, Bots, and Other Threats to Data Integrity in Online Research: Scoping Review of the Literature and Recommendations for Best Practices. Online Journal of Public Health Informatics. 2025;17:e70926-e70926. doi:10.2196/70926
BibTeX
@article{Strickland2025,
author = {Strickland, Isabella B and Ferketich, Amy K and Tackett, Alayna P and Patterson, Joanne G and Breitborde, Nicholas J K and Davis, Jade and Roberts, Megan},
title = {Imposters, Bots, and Other Threats to Data Integrity in Online Research: Scoping Review of the Literature and Recommendations for Best Practices},
journal = {Online Journal of Public Health Informatics},
year = {2025},
volume = {17},
pages = {e70926--e70926},
doi = {10.2196/70926}
}
EUVIMED