EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Planning for New Threats to Online Research Data Validity: The Issue of Computer-Using Agents

Jon Agley iD

Evaluation & the Health Professions · 2026

DOI: 10.1177/01632787251367407 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Evaluation & the Health Professions, 2026. Verfasst von Jon Agley. Beteiligte Einrichtung: Prevention Insights, School of Public Health-Bloomington, Indiana University Bloomington, IN, USA. Hauptthemen laut MEDLINE: Crowdsourcing, Data Accuracy, Internet. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Increasing numbers of research studies are completed entirely online, often using “crowdsourcing” platforms to recruit participants, such as Amazon’s Mechanical Turk (MTurk) or Prolific. Over time, crowdsourced data collection has faced multiple threats to validity including bots, inattention, and misrepresentation. Fortunately, research and development of quality control techniques has resulted in approaches to conducting credible research using crowdsourcing platforms. However, advances in large language models (LLMs), particularly computer-using agents (CUAs), such as OpenAI’s “Operator,” may pose novel threats to the validity of crowdsourced research data in the future. This brief report explores how and why that might be the case and encourages further discussion of this issue.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

CrowdsourcingData AccuracyInternetHumansReproducibility of ResultsResearch Design

Stichwörter der Autor:innen

CUALLMProlificbotcomputer-using agentcrowdsourcingmTurkonline experimentsurveyvalidity

Autor:innen und Institutionen

  • Prevention Insights, School of Public Health-Bloomington, Indiana University Bloomington, IN, USA.
  • Department of Applied Health Science, School of Public Health-Bloomington, Indiana University Bloomington, IN, USA.

ORCID-Profile: Jon Agley

Zitieren

APA

Agley, J. (2026). Planning for New Threats to Online Research Data Validity: The Issue of Computer-Using Agents. Evaluation & the Health Professions. https://doi.org/10.1177/01632787251367407

Vancouver

Agley J. Planning for New Threats to Online Research Data Validity: The Issue of Computer-Using Agents. Evaluation & the Health Professions. 2026. doi:10.1177/01632787251367407

BibTeX
@article{Agley2026,
  author = {Agley, Jon},
  title = {Planning for New Threats to Online Research Data Validity: The Issue of Computer-Using Agents},
  journal = {Evaluation & the Health Professions},
  year = {2026},
  doi = {10.1177/01632787251367407}
}
Kostenlos starten →