Generative AI in Academic Writing: A Comparison of DeepSeek, Qwen, ChatGPT, Gemini, Llama, Mistral, and Gemma
Turkish Journal of Engineering · 01.05.2026 · 10 (2) · 592-607
DOI: 10.31127/tuje.1838765 ↗Kurz gefasst
Fachartikel in der Zeitschrift Turkish Journal of Engineering, online erschienen am 01.05.2026. Verfasst von Ömer Aydın und 3 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 107 Literaturangaben.
Abstract (Originalsprache)
DeepSeek v3, developed in China, was released in December 2024, followed by Alibaba’s Qwen 2.5 Max in January 2025 and Qwen3 235B in April 2025. These free and open-source models offer significant potential for academic writing and content creation. This study evaluates their academic writing performance by comparing them with ChatGPT, Gemini, Llama, Mistral, and Gemma. There is a critical gap in the literature concerning how extensively these tools can be utilized and their potential to generate original content in terms of quality, readability, and effectiveness. Using 40 papers on Digital Twin and Healthcare, texts were generated through AI tools based on posed questions and paraphrased abstracts. The generated content was analyzed using similarity detection, AI detection, word count comparisons, semantic similarity, and readability assessments. Results indicate that paraphrased abstracts showed higher similarity rates, while question-based responses also exceeded acceptable levels. AI detection tools consistently identified all outputs as AI-generated. Word count analysis revealed that all chatbots produced a sufficient volume of content. Semantic similarity tests showed a strong overlap between generated and original texts. However, readability assessments indicated that the texts were insufficient in terms of clarity and accessibility. This study comparatively highlights the potential and limitations of popular and latest large language models for academic writing. While these models generate substantial and semantically accurate content, concerns regarding plagiarism, AI detection, and readability must be addressed for their effective use in scholarly work.
Zitieren
APA
Aydın, Ö., Karaarslan, E., Erenay, F. S., & Bacanin, N. (2026). Generative AI in Academic Writing: A Comparison of DeepSeek, Qwen, ChatGPT, Gemini, Llama, Mistral, and Gemma. Turkish Journal of Engineering, 10(2), 592-607. https://doi.org/10.31127/tuje.1838765
Vancouver
Aydın Ö, Karaarslan E, Erenay FS, Bacanin N. Generative AI in Academic Writing: A Comparison of DeepSeek, Qwen, ChatGPT, Gemini, Llama, Mistral, and Gemma. Turkish Journal of Engineering. 2026;10(2):592-607. doi:10.31127/tuje.1838765
BibTeX
@article{Aydn2026,
author = {Aydın, Ömer and Karaarslan, Enis and Erenay, Fatih Safa and Bacanin, Nebojsa},
title = {Generative AI in Academic Writing: A Comparison of DeepSeek, Qwen, ChatGPT, Gemini, Llama, Mistral, and Gemma},
journal = {Turkish Journal of Engineering},
year = {2026},
volume = {10},
number = {2},
pages = {592--607},
doi = {10.31127/tuje.1838765}
}
EUVIMED