EUVIMEDScopri EUVIMED
Open access

Artificial Intelligence Can Generate Fraudulent but Authentic-Looking Scientific Medical Articles: Pandora’s Box Has Been Opened

Martin Májovský iD, Martin Černý iD, Matěj Kasal iD, Martin Komarc iD, David Netuka iD

Journal of Medical Internet Research · 2023-05-31 · 25 · e46924

DOI: 10.2196/46924 ↗

At a glance

Journal article in Journal of Medical Internet Research, published online on 2023-05-31. Written by Martin Májovský and 4 co-authors. Institution: Department of Neurosurgery and Neurooncology, First Faculty of Medicine, Charles University, Prague, Czech Republic. Major MEDLINE topics: Artificial Intelligence, Algorithms. Cited 268 times so far (Crossref); 17 references. The full text is freely available in PubMed Central.

AbstractSubjectsDati bibliograficiCiteRelated studies

Abstract (original language)

Background

Artificial intelligence (AI) has advanced substantially in recent years, transforming many industries and improving the way people live and work. In scientific research, AI can enhance the quality and efficiency of data analysis and publication. However, AI has also opened up the possibility of generating high-quality fraudulent papers that are difficult to detect, raising important questions about the integrity of scientific research and the trustworthiness of published papers.

Objective

The aim of this study was to investigate the capabilities of current AI language models in generating high-quality fraudulent medical articles. We hypothesized that modern AI models can create highly convincing fraudulent papers that can easily deceive readers and even experienced researchers.

Methods

This proof-of-concept study used ChatGPT (Chat Generative Pre-trained Transformer) powered by the GPT-3 (Generative Pre-trained Transformer 3) language model to generate a fraudulent scientific article related to neurosurgery. GPT-3 is a large language model developed by OpenAI that uses deep learning algorithms to generate human-like text in response to prompts given by users. The model was trained on a massive corpus of text from the internet and is capable of generating high-quality text in a variety of languages and on various topics. The authors posed questions and prompts to the model and refined them iteratively as the model generated the responses. The goal was to create a completely fabricated article including the abstract, introduction, material and methods, discussion, references, charts, etc. Once the article was generated, it was reviewed for accuracy and coherence by experts in the fields of neurosurgery, psychiatry, and statistics and compared to existing similar articles.

Results

The study found that the AI language model can create a highly convincing fraudulent article that resembled a genuine scientific paper in terms of word usage, sentence structure, and overall composition. The AI-generated article included standard sections such as introduction, material and methods, results, and discussion, as well a data sheet. It consisted of 1992 words and 17 citations, and the whole process of article creation took approximately 1 hour without any special training of the human user. However, there were some concerns and specific mistakes identified in the generated article, specifically in the references.

Conclusions

The study demonstrates the potential of current AI language models to generate completely fabricated scientific articles. Although the papers look sophisticated and seemingly flawless, expert readers may identify semantic inaccuracies and errors upon closer inspection. We highlight the need for increased vigilance and better detection methods to combat the potential misuse of AI in scientific research. At the same time, it is important to recognize the potential benefits of using AI language models in genuine scientific writing and research, such as manuscript preparation and language editing.

Subjects

MeSH terms (MEDLINE)

Artificial IntelligenceAlgorithmsHumansLanguageSemanticsData Analysis

Author keywords

ChatGPTartificial intelligenceethicsfraudulent medical articleslanguage modelsneurosurgerypublications

Authors and institutions

  • Department of Neurosurgery and Neurooncology, First Faculty of Medicine, Charles University, Prague, Czech Republic.
  • Department of Psychiatry, Faculty of Medicine in Pilsen, Charles University, Pilsen, Czech Republic.
  • Institute of Biophysics and Informatics, First Faculty of Medicine, Charles University, Prague, Czech Republic.
  • Department of Methodology, Faculty of Physical Education and Sport, Charles University, Prague, Czech Republic.

ORCID profiles: Martin Májovský, Martin Černý, Matěj Kasal, Martin Komarc, David Netuka

Cite

APA

Májovský, M., Černý, M., Kasal, M., Komarc, M., & Netuka, D. (2023). Artificial Intelligence Can Generate Fraudulent but Authentic-Looking Scientific Medical Articles: Pandora’s Box Has Been Opened. Journal of Medical Internet Research, 25, e46924. https://doi.org/10.2196/46924

Vancouver

Májovský M, Černý M, Kasal M, Komarc M, Netuka D. Artificial Intelligence Can Generate Fraudulent but Authentic-Looking Scientific Medical Articles: Pandora’s Box Has Been Opened. Journal of Medical Internet Research. 2023;25:e46924. doi:10.2196/46924

BibTeX
@article{Mjovsk2023,
  author = {Májovský, Martin and Černý, Martin and Kasal, Matěj and Komarc, Martin and Netuka, David},
  title = {Artificial Intelligence Can Generate Fraudulent but Authentic-Looking Scientific Medical Articles: Pandora’s Box Has Been Opened},
  journal = {Journal of Medical Internet Research},
  year = {2023},
  volume = {25},
  pages = {e46924},
  doi = {10.2196/46924}
}
Start for free →