EUVIMEDEUVIMED entdecken
Crossref

Identifying and Managing Fraudulent Respondents in Online Stated Preferences Surveys: A Case Example from Best–Worst Scaling in Health Preferences Research

Karen V MacDonald, Geoffrey C Nguyen, Maida J Sewitch, Deborah A Marshall iD

The Patient - Patient-Centered Outcomes Research · 2025-07 · 18 (4) · 373-390

DOI: 10.1007/s40271-025-00740-y ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Patient - Patient-Centered Outcomes Research, online erschienen am 03.05.2025. Verfasst von Karen V MacDonald und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Room 3C58, Health Research Innovation Centre (HRIC), 3280…. Hauptthemen laut MEDLINE: Fraud, Patient Preference. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 34 Literaturangaben. Gefördert von: Canadian Institute of Health Research (CIHR), Crohn's and Colitis Canada, The IMAGINE Network.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

BACKGROUND: There is limited evidence and guidance in health preferences research to prevent, identify, and manage fraudulent respondents and data fraud, especially for best-worst scaling (BWS) and discrete choice experiments with nonordered attributes. Using an example from a BWS survey in which we experienced data fraud, we aimed to: (1) develop an approach to identify, verify, and categorize fraudulent respondents; (2) assess the impact of fraudulent respondents on data and results; and (3) identify variables associated with fraudulent respondents. METHODS: An online BWS survey on healthcare services for inflammatory bowel disease (IBD) was administered to Canadian IBD patients. We used a three-step approach to identify, verify, and categorize respondents as likely fraudulent (LF), likely real (LR), and unsure. First, responses to 12 "red flag" variables (variables identified as indicators of fraud) were coded 0 (pass) or 1 (fail) then summed to generate a "fraudulent response score" (FRS; range: 0-12 (most likely fraudulent)) used to categorize respondents. Second, respondents categorized LR or unsure underwent age verification. Third, categorization was updated on the basis of age verification results. BWS data were analyzed using conditional logit and latent class analysis. Subgroup analysis was done by final categorization, FRS, and red flag variables. RESULTS: Overall, n = 4334 respondents underwent initial categorization resulting in 24% (n = 1019) LF and 76% (n = 3315) needing further review. After review, 75% (n = 3258) were categorized as LF and n = 484 underwent age verification. Respondent categorization was updated on the basis of age verification, with final categorization of 76% (n = 3297) LF, 14% (n = 592) unsure, 10% (n = 442) LR, and < 1% (n = 3) duplicates of LR. BWS item rankings differed most by respondent category. Latent class analysis demonstrated final categorization was significantly associated with class membership; class 1 had characteristics consistent with LR respondents and item ranking order for class 1 closely aligned with LR respondent conditional logit results. Suspicious email was the most frequently failed red flag variable and was associated with fraudulent respondents. CONCLUSIONS: Additional steps to review data and verify age resulted in better categorization than only FRS or single red flag variables. Email authentication, single use/unique survey links, and built-in identification verification may be most effective for fraud prevention. Guidance is needed on good research practices for most effective and efficient approaches for preventing, identifying, and managing fraudulent data in health preferences research, specifically in studies with nonordered attributes.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

FraudPatient PreferenceHumansFemaleMaleAdultMiddle AgedSurveys and QuestionnairesCanadaInflammatory Bowel DiseasesInternetAged

Autor:innen und Institutionen

  • Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Room 3C58, Health Research Innovation Centre (HRIC), 3280 Hospital Drive NW, Calgary, AB, T2N 4Z6, Canada.
  • Mount Sinai Hospital Centre for Inflammatory Bowel Disease, Department of Medicine, University of Toronto, Toronto, ON, Canada.
  • Center for Outcomes Research and Evaluation (CORE), Research Institute of the McGill University Health Centre, Montreal, QC, Canada.
  • Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Room 3C58, Health Research Innovation Centre (HRIC), 3280 Hospital Drive NW, Calgary, AB, T2N 4Z6, Canada. damarsha@ucalgary.ca.

ORCID-Profile: Deborah A Marshall

Förderung

  • Canadian Institute of Health Research (CIHR)
  • Crohn's and Colitis Canada
  • The IMAGINE Network

Zitieren

APA

MacDonald, K. V., Nguyen, G. C., Sewitch, M. J., & Marshall, D. A. (2025). Identifying and Managing Fraudulent Respondents in Online Stated Preferences Surveys: A Case Example from Best–Worst Scaling in Health Preferences Research. The Patient - Patient-Centered Outcomes Research, 18(4), 373-390. https://doi.org/10.1007/s40271-025-00740-y

Vancouver

MacDonald KV, Nguyen GC, Sewitch MJ, Marshall DA. Identifying and Managing Fraudulent Respondents in Online Stated Preferences Surveys: A Case Example from Best–Worst Scaling in Health Preferences Research. The Patient - Patient-Centered Outcomes Research. 2025;18(4):373-390. doi:10.1007/s40271-025-00740-y

BibTeX
@article{MacDonald2025,
  author = {MacDonald, Karen V and Nguyen, Geoffrey C and Sewitch, Maida J and Marshall, Deborah A},
  title = {Identifying and Managing Fraudulent Respondents in Online Stated Preferences Surveys: A Case Example from Best–Worst Scaling in Health Preferences Research},
  journal = {The Patient - Patient-Centered Outcomes Research},
  year = {2025},
  volume = {18},
  number = {4},
  pages = {373--390},
  doi = {10.1007/s40271-025-00740-y}
}
Kostenlos starten →