Increasing Rigor in Online Health Surveys Through the Reduction of Fraudulent Data
Journal of Medical Internet Research · 2025-08-21 · 27 · e68092-e68092
DOI: 10.2196/68092 ↗At a glance
Journal article in Journal of Medical Internet Research, published online on 2025-08-21. Written by Wen Zhi Ng and 4 co-authors. Institution: Saw Swee Hock School of Public Health, National University of Singapore, National University Health System, 12 Science Drive 2, #10-01, Singapore, 11…. Major MEDLINE topics: Internet, Health Surveys, Fraud. Cited 15 times so far (Crossref); 57 references. The full text is freely available in PubMed Central. Funded by: NIAID NIH HHS, NICHD NIH HHS.
Abstract (original language)
Online surveys have become a key tool of modern health research, offering a fast, cost-effective, and convenient means of data collection. It enables researchers to access diverse populations, such as those underrepresented in traditional studies, and facilitates the collection of stigmatized or sensitive behaviors through greater anonymity. However, the ease of participation also introduces significant challenges, particularly around data integrity and rigor. As fraudulent responses—whether from bots, repeat responders, or individuals misrepresenting themselves—become more sophisticated and pervasive, ensuring the rigor of online surveys has never been more crucial. This article provides a comprehensive synthesis of practical strategies that help to increase the rigor of online surveys through the detection and removal of fraudulent data. Drawing on recent literature and case studies, we outline several options that address the full research cycle from predata collection strategies to validation post data collection. We emphasize the integration of automated screening techniques (eg, CAPTCHAs and honeypot questions) and attention checks (eg, trap questions) for purposeful survey design. Robust recruitment procedures (eg, concealed eligibility criteria and 2-stage screening) and a proper incentive or compensation structure can also help to deter fraudulent participation. We examine the merits and limitations of different sampling methodologies, including river sampling, online panels, and crowdsourcing platforms, offering guidance on how to select samples based on specific research objectives. Post data collection, we discuss metadata-based techniques to detect fraudulent data (eg, duplicate email or IP addresses, response time analysis), alongside methods to better screen for low-quality responses (eg, inconsistent response patterns and improbable qualitative responses). The escalating sophistication of fraud tactics, particularly with the growth of artificial intelligence (AI), demands that researchers continuously adapt and stay vigilant. We propose the use of dynamic protocols, combining multiple strategies into a multipronged approach that can better filter for fraudulent data and evolve depending on the type of responses received across the data collection process. However, there is still significant room for strategies to develop, and it should be a key focus for upcoming research. As online surveys become increasingly integral to health research, investing in robust strategies to screen for fraudulent data and increasing the rigor of studies is key to upholding scientific integrity.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Saw Swee Hock School of Public Health, National University of Singapore, National University Health System, 12 Science Drive 2, #10-01, Singapore, 117549, Singapore, 65 91878576.
- Yale-NUS College, National University of Singapore, Singapore, Singapore.
- Health and Social Sciences Cluster, Singapore Institute of Technology, Singapore, Singapore.
- London School of Hygiene and Tropical Medicine, London, United Kingdom.
- UNC School of Medicine, University of North Carolina at Chapel Hill, Chapel Hill, NC, United States.
ORCID profiles: Wen Zhi Ng, Sundarimaa Erdembileg, Jean C J Liu, Joseph D Tucker, Rayner Kay Jin Tan
Funding
- NIAID NIH HHS
- NICHD NIH HHS
Cite
APA
Ng, W. Z., Erdembileg, S., Liu, J. C. J., Tucker, J. D., & Tan, R. K. J. (2025). Increasing Rigor in Online Health Surveys Through the Reduction of Fraudulent Data. Journal of Medical Internet Research, 27, e68092-e68092. https://doi.org/10.2196/68092
Vancouver
Ng WZ, Erdembileg S, Liu JCJ, Tucker JD, Tan RKJ. Increasing Rigor in Online Health Surveys Through the Reduction of Fraudulent Data. Journal of Medical Internet Research. 2025;27:e68092-e68092. doi:10.2196/68092
BibTeX
@article{Ng2025,
author = {Ng, Wen Zhi and Erdembileg, Sundarimaa and Liu, Jean C J and Tucker, Joseph D and Tan, Rayner Kay Jin},
title = {Increasing Rigor in Online Health Surveys Through the Reduction of Fraudulent Data},
journal = {Journal of Medical Internet Research},
year = {2025},
volume = {27},
pages = {e68092--e68092},
doi = {10.2196/68092}
}
EUVIMED