Machine Learning Based Identification of LLM Generated Scientific Research Article Abstracts
Scientific Journal of Mehmet Akif Ersoy University · 2025
DOI: 10.70030/sjmakeu.1730246 ↗Kurz gefasst
Fachartikel in der Zeitschrift Scientific Journal of Mehmet Akif Ersoy University, 2025. Verfasst von Burcu Baştürk und 1 weiteren Autor:innen. Die Arbeit nennt 42 Literaturangaben.
Abstract (Originalsprache)
Heart disease is one of the leading causes of death worldwide, making early detection and diagnosis essential for effective treatment. With advancements in machine learning (ML) and artificial intelligence (AI), these technologies are being increasingly applied in the medical field, particularly for detecting and predicting heart disease. As AI systems become more complex, it becomes important to distinguish between abstracts generated by AI algorithms and those prepared by human experts. This study aims to develop and assess ML approaches to distinguish between human-written and AI-generated (ChatGPT and NLTK) heart disease abstracts. Using a dataset of 15,000 abstracts (5,000 written by humans, 5,000 reworded by ChatGPT, and 5,000 generated using NLTK), various Natural Language Processing (NLP) techniques, such as tokenization, stop word removal, stemming and lemmatization were applied. The text data was transformed into numerical form using TF-IDF vectorization. Different ML models, including K-nearest neighbors (KNN), support vector machines (SVMs), logistic regression, random forest, decision tree were trained and tested for their classification accuracy. This study highlights the significant potential of ML techniques in ensuring transparency and reliability in AI-driven medical decision-making, especially in the area of heart disease diagnosis.
Zitieren
APA
Baştürk, B., & Onan, A. (2025). Machine Learning Based Identification of LLM Generated Scientific Research Article Abstracts. Scientific Journal of Mehmet Akif Ersoy University. https://doi.org/10.70030/sjmakeu.1730246
Vancouver
Baştürk B, Onan A. Machine Learning Based Identification of LLM Generated Scientific Research Article Abstracts. Scientific Journal of Mehmet Akif Ersoy University. 2025. doi:10.70030/sjmakeu.1730246
BibTeX
@article{Batrk2025,
author = {Baştürk, Burcu and Onan, Aytuğ},
title = {Machine Learning Based Identification of LLM Generated Scientific Research Article Abstracts},
journal = {Scientific Journal of Mehmet Akif Ersoy University},
year = {2025},
doi = {10.70030/sjmakeu.1730246}
}
EUVIMED