EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Experimental evidence of the effects of large language models versus web search on depth of learning

Shiri Melumad iD, Jin Ho Yun iD

PNAS Nexus · 30.09.2025 · 4 (10)

DOI: 10.1093/pnasnexus/pgaf316 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PNAS Nexus, online erschienen am 28.10.2025. Verfasst von Shiri Melumad und 1 weiteren Autor:innen. Beteiligte Einrichtung: The Wharton School, University of Pennsylvania, Philadelphia, PA 19104, USA. Die Arbeit wurde bisher 54-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The effects of using large language models (LLMs) versus traditional web search on depth of learning are explored. A theory is proposed that when individuals learn about a topic from LLM syntheses, they risk developing shallower knowledge than when they learn through standard web search, even when the core facts in the results are the same. This shallower knowledge accrues from an inherent feature of LLMs—the presentation of results as summaries of vast arrays of information rather than individual search links—which inhibits users from actively discovering and synthesizing information sources themselves, as in traditional web search. Thus, when subsequently forming advice on the topic based on their search, those who learn from LLM syntheses (vs. traditional web links) feel less invested in forming their advice, and, more importantly, create advice that is sparser, less original, and ultimately less likely to be adopted by recipients. Results from seven online and laboratory experiments (n = 10,462) lend support for these predictions, and confirm, for example, that participants reported developing shallower knowledge from LLM summaries even when the results were augmented by real-time web links. Implications of the findings for recent research on the benefits and risks of LLMs, as well as limitations of the work, are discussed.

Schlagwörter

Stichwörter der Autor:innen

large language modelslearningnatural language processingsearch processweb search

Autor:innen und Institutionen

  • The Wharton School, University of Pennsylvania, Philadelphia, PA 19104, USA.
  • College of Business, New Mexico State University, Las Cruces, NM 88003, USA.
  • Wharton Neuroscience Initiative, University of Pennsylvania, Philadelphia, PA 19104, USA.

ORCID-Profile: Shiri Melumad, Jin Ho Yun

Zitieren

APA

Melumad, S., & Yun, J. H. (2025). Experimental evidence of the effects of large language models versus web search on depth of learning. PNAS Nexus, 4(10). https://doi.org/10.1093/pnasnexus/pgaf316

Vancouver

Melumad S, Yun JH. Experimental evidence of the effects of large language models versus web search on depth of learning. PNAS Nexus. 2025;4(10). doi:10.1093/pnasnexus/pgaf316

BibTeX
@article{Melumad2025,
  author = {Melumad, Shiri and Yun, Jin Ho},
  title = {Experimental evidence of the effects of large language models versus web search on depth of learning},
  journal = {PNAS Nexus},
  year = {2025},
  volume = {4},
  number = {10},
  doi = {10.1093/pnasnexus/pgaf316}
}
Kostenlos starten →