EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Artificial intelligence as author: Can scientific reviewers recognize GPT-4o-generated manuscripts?

Ahmet Öztürk, Anılcan Tahsin Karahan, Serkan Günay, Abdul Samed Erdal, Seval Komut, Erdal Komut, Yavuz Yiğit

The American Journal of Emergency Medicine · 2025-11 · 97 · 216-219

DOI: 10.1016/j.ajem.2025.07.034 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The American Journal of Emergency Medicine, 2025-11. Verfasst von Ahmet Öztürk und 6 weiteren Autor:innen. Beteiligte Einrichtung: Hitit University Erol Olçok Education and Research Hospital, Department of Emergency Medicine, Çorum, Turkey. Hauptthemen laut MEDLINE: Artificial Intelligence, Authorship, Natural Language Processing, Peer Review, Research. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 8 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

INTRODUCTION: Chat Generative Pre-Trained Transformer (ChatGPT) is a natural language processing model. It can be argued that ChatGPT has recently begun to assume the role of a technological assistant capable of supporting academics in the process of scientific writing. ChatGPT may contribute to the spread of incorrect or incomplete information within academic literature, leading to conceptual confusion and potential academic misconduct. The aim of this study is to determine whether a scientific article entirely generated by an AI application such as ChatGPT can be detected by an academic journal editor or peer reviewer. METHODS: This study was conducted between November 1, 2024, and December 1, 2024. GPT-4o, was utilized in this study. ChatGPT was instructed to write a scientific article focused on predicting mortality and return of spontaneous circulation (ROSC) in OHCA cases. The manuscript written by ChatGPT-4o was sent to 14 different reviewers who had previously served as reviewers or editors. The reviewers were asked to evaluate the manuscript as if they were an SCI-E journal editor or peer reviewer. The reviewers were informed that the article had been written by ChatGPT and were asked whether they had identified this during their review. RESULTS: Among the reviewers, 42.9 % (n = 6) decided to reject the manuscript at the editorial stage, whereas another 42.9 % (n = 6) opted to forward it to a peer reviewer. During the peer review stage, 42.9 % (n = 6) of the reviewers recommended rejection, while 28.6 % (n = 4) suggested major revisions. 78.6 % (n = 11) of the reviewers did not realize that the manuscript had been generated by an artificial intelligence model. CONCLUSION: The findings of our study highlight the necessity for journal editors and peer reviewers to be well-informed about ChatGPT and to develop systems capable of identifying whether a manuscript has been written by a human or generated by artificial intelligence.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceAuthorshipNatural Language ProcessingPeer Review, ResearchHumans

Stichwörter der Autor:innen

Artificial intelligenceChatGPTEditorJournalReviewer

Autor:innen und Institutionen

  • Hitit University Erol Olçok Education and Research Hospital, Department of Emergency Medicine, Çorum, Turkey.
  • Hitit University Erol Olçok Education and Research Hospital, Department of Pharmacy, Çorum, Turkey.
  • Hitit University Erol Olçok Education and Research Hospital, Department of Radiology, Çorum, Turkey.
  • Hamad Medical Corporation, Hamad General Hospital, Department of Emergency Medicine, Doha, Qatar; Blizard Institute, Queen Mary University, Department of Emergency Medicine, London, UK. Electronic address: yyigit@hamad.…

Zitieren

APA

Öztürk, A., Karahan, A. T., Günay, S., Erdal, A. S., Komut, S., Komut, E., & Yiğit, Y. (2025). Artificial intelligence as author: Can scientific reviewers recognize GPT-4o-generated manuscripts?. The American Journal of Emergency Medicine, 97, 216-219. https://doi.org/10.1016/j.ajem.2025.07.034

Vancouver

Öztürk A, Karahan AT, Günay S, Erdal AS, Komut S, Komut E, et al. Artificial intelligence as author: Can scientific reviewers recognize GPT-4o-generated manuscripts?. The American Journal of Emergency Medicine. 2025;97:216-219. doi:10.1016/j.ajem.2025.07.034

BibTeX
@article{ztrk2025,
  author = {Öztürk, Ahmet and Karahan, Anılcan Tahsin and Günay, Serkan and Erdal, Abdul Samed and Komut, Seval and Komut, Erdal and Yiğit, Yavuz},
  title = {Artificial intelligence as author: Can scientific reviewers recognize GPT-4o-generated manuscripts?},
  journal = {The American Journal of Emergency Medicine},
  year = {2025},
  volume = {97},
  pages = {216--219},
  doi = {10.1016/j.ajem.2025.07.034}
}
Kostenlos starten →