EUVIMEDEUVIMED entdecken
Crossref

Artificial Intelligence–Generated Scientific Literature: A Critical Appraisal

Justyna Zybaczynska, Matthew Norris, Sunjay Modi, Jennifer Brennan, Pooja Jhaveri, Timothy J Craig, Taha Al-Shaikhly

The Journal of Allergy and Clinical Immunology: In Practice · 2024

DOI: 10.1016/j.jaip.2023.10.010 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Journal of Allergy and Clinical Immunology: In Practice, 2024. Verfasst von Justyna Zybaczynska und 6 weiteren Autor:innen. Beteiligte Einrichtung: Section of Allergy, Asthma & Immunology, Department of Medicine, Pennsylvania State University College of Medicine, Hershey, Pa. Hauptthemen laut MEDLINE: Angioedemas, Hereditary, Eosinophilic Esophagitis. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 21 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

BACKGROUND: Review articles play a critical role in informing medical decisions and identifying avenues for future research. With the introduction of artificial intelligence (AI), there has been a growing interest in the potential of this technology to transform the synthesis of medical literature. Open AI's Generative Pre-trained Transformer (GPT-4) (Open AI Inc, San Francisco, CA) tool provides access to advanced AI that is able to quickly produce medical literature following only simple prompts. The accuracy of the generated articles requires review, especially in subspecialty fields like Allergy/Immunology. OBJECTIVE: To critically appraise AI-synthesized allergy-focused minireviews. METHODS: We tasked the GPT-4 Chatbot with generating 2 1,000-word reviews on the topics of hereditary angioedema and eosinophilic esophagitis. Authors critically appraised these articles using the Joanna Briggs Institute (JBI) tool for text and opinion and additionally evaluated domains of interest such as language, reference quality, and accuracy of the content. RESULTS: The language of the AI-generated minireviews was carefully articulated and logically focused on the topic of interest; however, reviewers of the AI-generated articles indicated that the AI-generated content lacked depth, did not appear to be the result of an analytical process, missed critical information, and contained inaccurate information. Despite being provided instruction to utilize scientific references, the AI chatbot relied mainly on freely available resources, and the AI chatbot fabricated references. CONCLUSIONS: The AI holds the potential to change the landscape of synthesizing medical literature; however, apparent inaccurate and fabricated information calls for rigorous evaluation and validation of AI tools in generating medical literature, especially on subjects associated with limited resources.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Angioedemas, HereditaryEosinophilic EsophagitisHumansArtificial IntelligenceSoftwareLanguage

Stichwörter der Autor:innen

AIArtificial intelligenceChat-GPTFabricationGPT-4Medical literatureReview articles

Autor:innen und Institutionen

  • Section of Allergy, Asthma & Immunology, Department of Medicine, Pennsylvania State University College of Medicine, Hershey, Pa.
  • Division of Allergy & Immunology, Department of Pediatrics, Pennsylvania State University College of Medicine, Hershey, Pa.
  • Section of Allergy, Asthma & Immunology, Department of Medicine, Pennsylvania State University College of Medicine, Hershey, Pa. Electronic address: talshaikhly@pennstatehealth.psu.edu.

Zitieren

APA

Zybaczynska, J., Norris, M., Modi, S., Brennan, J., Jhaveri, P., Craig, T. J., & Al-Shaikhly, T. (2024). Artificial Intelligence–Generated Scientific Literature: A Critical Appraisal. The Journal of Allergy and Clinical Immunology: In Practice. https://doi.org/10.1016/j.jaip.2023.10.010

Vancouver

Zybaczynska J, Norris M, Modi S, Brennan J, Jhaveri P, Craig TJ, et al. Artificial Intelligence–Generated Scientific Literature: A Critical Appraisal. The Journal of Allergy and Clinical Immunology: In Practice. 2024. doi:10.1016/j.jaip.2023.10.010

BibTeX
@article{Zybaczynska2024,
  author = {Zybaczynska, Justyna and Norris, Matthew and Modi, Sunjay and Brennan, Jennifer and Jhaveri, Pooja and Craig, Timothy J and Al-Shaikhly, Taha},
  title = {Artificial Intelligence–Generated Scientific Literature: A Critical Appraisal},
  journal = {The Journal of Allergy and Clinical Immunology: In Practice},
  year = {2024},
  doi = {10.1016/j.jaip.2023.10.010}
}
Kostenlos starten →