Experimental evidence of the effects of large language models versus web search on depth of learning
PNAS Nexus · 30.09.2025 · 4 (10)
DOI: 10.1093/pnasnexus/pgaf316 ↗Kurz gefasst
Fachartikel in der Zeitschrift PNAS Nexus, online erschienen am 28.10.2025. Verfasst von Shiri Melumad und 1 weiteren Autor:innen. Beteiligte Einrichtung: The Wharton School, University of Pennsylvania, Philadelphia, PA 19104, USA. Die Arbeit wurde bisher 54-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
The effects of using large language models (LLMs) versus traditional web search on depth of learning are explored. A theory is proposed that when individuals learn about a topic from LLM syntheses, they risk developing shallower knowledge than when they learn through standard web search, even when the core facts in the results are the same. This shallower knowledge accrues from an inherent feature of LLMs—the presentation of results as summaries of vast arrays of information rather than individual search links—which inhibits users from actively discovering and synthesizing information sources themselves, as in traditional web search. Thus, when subsequently forming advice on the topic based on their search, those who learn from LLM syntheses (vs. traditional web links) feel less invested in forming their advice, and, more importantly, create advice that is sparser, less original, and ultimately less likely to be adopted by recipients. Results from seven online and laboratory experiments (n = 10,462) lend support for these predictions, and confirm, for example, that participants reported developing shallower knowledge from LLM summaries even when the results were augmented by real-time web links. Implications of the findings for recent research on the benefits and risks of LLMs, as well as limitations of the work, are discussed.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- The Wharton School, University of Pennsylvania, Philadelphia, PA 19104, USA.
- College of Business, New Mexico State University, Las Cruces, NM 88003, USA.
- Wharton Neuroscience Initiative, University of Pennsylvania, Philadelphia, PA 19104, USA.
ORCID-Profile: Shiri Melumad, Jin Ho Yun
Zitieren
APA
Melumad, S., & Yun, J. H. (2025). Experimental evidence of the effects of large language models versus web search on depth of learning. PNAS Nexus, 4(10). https://doi.org/10.1093/pnasnexus/pgaf316
Vancouver
Melumad S, Yun JH. Experimental evidence of the effects of large language models versus web search on depth of learning. PNAS Nexus. 2025;4(10). doi:10.1093/pnasnexus/pgaf316
BibTeX
@article{Melumad2025,
author = {Melumad, Shiri and Yun, Jin Ho},
title = {Experimental evidence of the effects of large language models versus web search on depth of learning},
journal = {PNAS Nexus},
year = {2025},
volume = {4},
number = {10},
doi = {10.1093/pnasnexus/pgaf316}
}
EUVIMED