Perceptions and detection of AI use in manuscript preparation for academic journals
PLOS ONE · 12.07.2024 · 19 (7) · e0304807
DOI: 10.1371/journal.pone.0304807 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS ONE, online erschienen am 12.07.2024. Verfasst von Nir Chemaya und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Economics, University of California, Santa Barbara, Santa Barbara, California, United States of America. Hauptthemen laut MEDLINE: Artificial Intelligence. Die Arbeit wurde bisher 52-mal zitiert (Crossref) und nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
The rapid advances in Generative AI tools have produced both excitement and worry about how AI will impact academic writing. However, little is known about what norms are emerging around AI use in manuscript preparation or how these norms might be enforced. We address both gaps in the literature by conducting a survey of 271 academics about whether it is necessary to report ChatGPT use in manuscript preparation and by running GPT-modified abstracts from 2,716 published papers through a leading AI detection software to see if these detectors can detect different AI uses in manuscript preparation. We find that most academics do not think that using ChatGPT to fix grammar needs to be reported, but detection software did not always draw this distinction, as abstracts for which GPT was used to fix grammar were often flagged as having a high chance of being written by AI. We also find disagreements among academics on whether more substantial use of ChatGPT to rewrite text needs to be reported, and these differences were related to perceptions of ethics, academic role, and English language background. Finally, we found little difference in their perceptions about reporting ChatGPT and research assistant help, but significant differences in reporting perceptions between these sources of assistance and paid proofreading and other AI assistant tools (Grammarly and Word). Our results suggest that there might be challenges in getting authors to report AI use in manuscript preparation because (i) there is not uniform agreement about what uses of AI should be reported and (ii) journals might have trouble enforcing nuanced reporting requirements using AI detection tools.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Economics, University of California, Santa Barbara, Santa Barbara, California, United States of America.
- Kellogg School of Management, Northwestern University, Evanston, Illinois, United States of America.
ORCID-Profile: Daniel Martin
Zitieren
APA
Chemaya, N., & Martin, D. (2024). Perceptions and detection of AI use in manuscript preparation for academic journals. PLOS ONE, 19(7), e0304807. https://doi.org/10.1371/journal.pone.0304807
Vancouver
Chemaya N, Martin D. Perceptions and detection of AI use in manuscript preparation for academic journals. PLOS ONE. 2024;19(7):e0304807. doi:10.1371/journal.pone.0304807
BibTeX
@article{Chemaya2024,
author = {Chemaya, Nir and Martin, Daniel},
title = {Perceptions and detection of AI use in manuscript preparation for academic journals},
journal = {PLOS ONE},
year = {2024},
volume = {19},
number = {7},
pages = {e0304807},
doi = {10.1371/journal.pone.0304807}
}
EUVIMED