EUVIMEDEUVIMED entdecken
Open Access

Delving into LLM-assisted writing in biomedical publications through excess vocabulary

Dmitry Kobak iD, Rita González-Márquez iD, Emőke-Ágnes Horvát iD, Jan Lause

Science Advances · 04.07.2025 · 11 (27)

DOI: 10.1126/sciadv.adt3813 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Science Advances, erschienen am 04.07.2025. Verfasst von Dmitry Kobak und 3 weiteren Autor:innen. Beteiligte Einrichtung: Hertie Institute for AI in Brain Health, University of Tübingen, 72076 Tübingen, Germany. Hauptthemen laut MEDLINE: Vocabulary, Biomedical Research, Writing, Language. Die Arbeit wurde bisher 193-mal zitiert (Crossref) und nennt 58 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large language models (LLMs) like ChatGPT can generate and revise text with human-level performance. These models come with clear limitations, can produce inaccurate information, and reinforce existing biases. Yet, many scientists use them for their scholarly writing. But how widespread is such LLM usage in the academic literature? To answer this question for the field of biomedical research, we present an unbiased, large-scale approach: We study vocabulary changes in more than 15 million biomedical abstracts from 2010 to 2024 indexed by PubMed and show how the appearance of LLMs led to an abrupt increase in the frequency of certain style words. This excess word analysis suggests that at least 13.5% of 2024 abstracts were processed with LLMs. This lower bound differed across disciplines, countries, and journals, reaching 40% for some subcorpora. We show that LLMs have had an unprecedented impact on scientific writing in biomedical research, surpassing the effect of major world events such as the COVID pandemic.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

VocabularyBiomedical ResearchWritingLanguagePublicationsHumans

Autor:innen und Institutionen

  • Hertie Institute for AI in Brain Health, University of Tübingen, 72076 Tübingen, Germany.
  • Northwestern University, Evanston, 60208 IL, USA.

ORCID-Profile: Dmitry Kobak, Rita González-Márquez, Emőke-Ágnes Horvát

Zitieren

APA

Kobak, D., González-Márquez, R., Horvát, E. Á., & Lause, J. (2025). Delving into LLM-assisted writing in biomedical publications through excess vocabulary. Science Advances, 11(27). https://doi.org/10.1126/sciadv.adt3813

Vancouver

Kobak D, González-Márquez R, Horvát EÁ, Lause J. Delving into LLM-assisted writing in biomedical publications through excess vocabulary. Science Advances. 2025;11(27). doi:10.1126/sciadv.adt3813

BibTeX
@article{Kobak2025,
  author = {Kobak, Dmitry and González-Márquez, Rita and Horvát, Emőke-Ágnes and Lause, Jan},
  title = {Delving into LLM-assisted writing in biomedical publications through excess vocabulary},
  journal = {Science Advances},
  year = {2025},
  volume = {11},
  number = {27},
  doi = {10.1126/sciadv.adt3813}
}
Kostenlos starten →