Delving into LLM-assisted writing in biomedical publications through excess vocabulary
Science Advances · 04.07.2025 · 11 (27)
DOI: 10.1126/sciadv.adt3813 ↗Kurz gefasst
Fachartikel in der Zeitschrift Science Advances, erschienen am 04.07.2025. Verfasst von Dmitry Kobak und 3 weiteren Autor:innen. Beteiligte Einrichtung: Hertie Institute for AI in Brain Health, University of Tübingen, 72076 Tübingen, Germany. Hauptthemen laut MEDLINE: Vocabulary, Biomedical Research, Writing, Language. Die Arbeit wurde bisher 193-mal zitiert (Crossref) und nennt 58 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Large language models (LLMs) like ChatGPT can generate and revise text with human-level performance. These models come with clear limitations, can produce inaccurate information, and reinforce existing biases. Yet, many scientists use them for their scholarly writing. But how widespread is such LLM usage in the academic literature? To answer this question for the field of biomedical research, we present an unbiased, large-scale approach: We study vocabulary changes in more than 15 million biomedical abstracts from 2010 to 2024 indexed by PubMed and show how the appearance of LLMs led to an abrupt increase in the frequency of certain style words. This excess word analysis suggests that at least 13.5% of 2024 abstracts were processed with LLMs. This lower bound differed across disciplines, countries, and journals, reaching 40% for some subcorpora. We show that LLMs have had an unprecedented impact on scientific writing in biomedical research, surpassing the effect of major world events such as the COVID pandemic.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Hertie Institute for AI in Brain Health, University of Tübingen, 72076 Tübingen, Germany.
- Northwestern University, Evanston, 60208 IL, USA.
ORCID-Profile: Dmitry Kobak, Rita González-Márquez, Emőke-Ágnes Horvát
Zitieren
APA
Kobak, D., González-Márquez, R., Horvát, E. Á., & Lause, J. (2025). Delving into LLM-assisted writing in biomedical publications through excess vocabulary. Science Advances, 11(27). https://doi.org/10.1126/sciadv.adt3813
Vancouver
Kobak D, González-Márquez R, Horvát EÁ, Lause J. Delving into LLM-assisted writing in biomedical publications through excess vocabulary. Science Advances. 2025;11(27). doi:10.1126/sciadv.adt3813
BibTeX
@article{Kobak2025,
author = {Kobak, Dmitry and González-Márquez, Rita and Horvát, Emőke-Ágnes and Lause, Jan},
title = {Delving into LLM-assisted writing in biomedical publications through excess vocabulary},
journal = {Science Advances},
year = {2025},
volume = {11},
number = {27},
doi = {10.1126/sciadv.adt3813}
}
EUVIMED