EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

When the source is a bot: How people adapt their evaluation strategies to assess AI-generated content

Shakked Dabran-Zivan iD, Inbal Klein-Avraham iD, Ayelet Baram-Tsabari

PLOS One · 30.03.2026 · 21 (3) · e0345300

DOI: 10.1371/journal.pone.0345300 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS One, online erschienen am 30.03.2026. Verfasst von Shakked Dabran-Zivan und 2 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Education in Science and Technology, Technion Israel Institute of Technology, Haifa, Israel. Hauptthemen laut MEDLINE: Generative Artificial Intelligence, Artificial Intelligence. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 69 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Niedersächsisches Ministerium für Wissenschaft und Kultur.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Generative artificial intelligence (GenAI) blurs the boundaries between expert and non-expert sources, as it increasingly distributes and creates scientific content. This study examines how individuals adapt evaluation strategies, including content and source evaluation, and corroboration, when using GenAI versus a search engine. Based on performance tasks in which participants evaluated science-related socio-scientific dilemmas and follow-up interviews with 30 adult participants from diverse educational backgrounds, findings reveal that users employed these strategies on both platforms but adapted them in distinct ways. We identified two evaluation strategies that emerged as analytical constructs from the qualitative data. First, to corroborate output, participants frequently used a strategy we titled ‘representation evaluation,’ assessing whether GenAI accurately summarized its sources rather than verifying source agreement independently. Second, participants also applied ‘meta source evaluation,’ relying on their familiarity with sources provided by GenAI instead of directly evaluating the sources themselves. Although all participants engaged in dialogue with the chat, they did not leverage the bot’s dialogue capabilities to assess credibility, and many relied on a “machine heuristic”, assuming GenAI’s inherent correctness, reflecting a well-documented over-trust in automated systems. This research underscores the importance of developing and assessing critical evaluation skills for navigating AI-generated scientific information. Specifically, it extends existing models of online information evaluation to contexts mediated by artificial intelligence.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Generative Artificial IntelligenceArtificial IntelligenceHumansAdultFemaleMaleIntelligent Systems

Autor:innen und Institutionen

  • Faculty of Education in Science and Technology, Technion Israel Institute of Technology, Haifa, Israel.

ORCID-Profile: Shakked Dabran-Zivan, Inbal Klein-Avraham

Förderung

  • Niedersächsisches Ministerium für Wissenschaft und Kultur

Zitieren

APA

Dabran-Zivan, S., Klein-Avraham, I., & Baram-Tsabari, A. (2026). When the source is a bot: How people adapt their evaluation strategies to assess AI-generated content. PLOS One, 21(3), e0345300. https://doi.org/10.1371/journal.pone.0345300

Vancouver

Dabran-Zivan S, Klein-Avraham I, Baram-Tsabari A. When the source is a bot: How people adapt their evaluation strategies to assess AI-generated content. PLOS One. 2026;21(3):e0345300. doi:10.1371/journal.pone.0345300

BibTeX
@article{DabranZivan2026,
  author = {Dabran-Zivan, Shakked and Klein-Avraham, Inbal and Baram-Tsabari, Ayelet},
  title = {When the source is a bot: How people adapt their evaluation strategies to assess AI-generated content},
  journal = {PLOS One},
  year = {2026},
  volume = {21},
  number = {3},
  pages = {e0345300},
  doi = {10.1371/journal.pone.0345300}
}
Kostenlos starten →