Planning for New Threats to Online Research Data Validity: The Issue of Computer-Using Agents
Evaluation & the Health Professions · 2026
DOI: 10.1177/01632787251367407 ↗Kurz gefasst
Fachartikel in der Zeitschrift Evaluation & the Health Professions, 2026. Verfasst von Jon Agley. Beteiligte Einrichtung: Prevention Insights, School of Public Health-Bloomington, Indiana University Bloomington, IN, USA. Hauptthemen laut MEDLINE: Crowdsourcing, Data Accuracy, Internet. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Increasing numbers of research studies are completed entirely online, often using “crowdsourcing” platforms to recruit participants, such as Amazon’s Mechanical Turk (MTurk) or Prolific. Over time, crowdsourced data collection has faced multiple threats to validity including bots, inattention, and misrepresentation. Fortunately, research and development of quality control techniques has resulted in approaches to conducting credible research using crowdsourcing platforms. However, advances in large language models (LLMs), particularly computer-using agents (CUAs), such as OpenAI’s “Operator,” may pose novel threats to the validity of crowdsourced research data in the future. This brief report explores how and why that might be the case and encourages further discussion of this issue.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Prevention Insights, School of Public Health-Bloomington, Indiana University Bloomington, IN, USA.
- Department of Applied Health Science, School of Public Health-Bloomington, Indiana University Bloomington, IN, USA.
ORCID-Profile: Jon Agley
Zitieren
APA
Agley, J. (2026). Planning for New Threats to Online Research Data Validity: The Issue of Computer-Using Agents. Evaluation & the Health Professions. https://doi.org/10.1177/01632787251367407
Vancouver
Agley J. Planning for New Threats to Online Research Data Validity: The Issue of Computer-Using Agents. Evaluation & the Health Professions. 2026. doi:10.1177/01632787251367407
BibTeX
@article{Agley2026,
author = {Agley, Jon},
title = {Planning for New Threats to Online Research Data Validity: The Issue of Computer-Using Agents},
journal = {Evaluation & the Health Professions},
year = {2026},
doi = {10.1177/01632787251367407}
}
EUVIMED