The Performance and Reliability of Generative AI Models in Software Development: A C# Based Analysis
MANAS Journal of Engineering · 29.12.2025 · 13 (2) · 125-142
DOI: 10.51354/mjen.1784716 ↗Kurz gefasst
Fachartikel in der Zeitschrift MANAS Journal of Engineering, online erschienen am 29.12.2025. Verfasst von Halil Kaynarpınar und 1 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 36 Literaturangaben.
Abstract (Originalsprache)
The effectiveness of generative artificial intelligence models in software development is determined not only by their ability to generate correct solutions but also by their adherence to quality metrics and their resilience to exceptional scenarios. In this context, a comparative evaluation was conducted on four models using 10 fundamental algorithm problems and 10 object-oriented programming problems in the C# programming language. The generated solutions were assessed in terms of time complexity, memory usage, lines of code, number of variables and methods, and execution time. In addition, meaningful edge-case scenarios were employed to measure error tolerance and exception handling performance. The findings indicate that all models produced functionally valid solutions, yet exhibited limitations in advanced software engineering practices such as modularity, comprehensive error management, performance measurement, and unit testing. The analysis revealed that ChatGPT and Gemini stood out in terms of structure and consistency, Claude demonstrated greater reliability in handling errors, while Copilot offered advantages in code simplicity. Overall, the results highlight the importance of evaluating generative AI models not only under ideal conditions but also in atypical scenarios to ensure software quality and reliability.
Zitieren
APA
Kaynarpınar, H., & Şeker, A. (2025). The Performance and Reliability of Generative AI Models in Software Development: A C# Based Analysis. MANAS Journal of Engineering, 13(2), 125-142. https://doi.org/10.51354/mjen.1784716
Vancouver
Kaynarpınar H, Şeker A. The Performance and Reliability of Generative AI Models in Software Development: A C# Based Analysis. MANAS Journal of Engineering. 2025;13(2):125-142. doi:10.51354/mjen.1784716
BibTeX
@article{Kaynarpnar2025,
author = {Kaynarpınar, Halil and Şeker, Abdulkadir},
title = {The Performance and Reliability of Generative AI Models in Software Development: A C# Based Analysis},
journal = {MANAS Journal of Engineering},
year = {2025},
volume = {13},
number = {2},
pages = {125--142},
doi = {10.51354/mjen.1784716}
}
EUVIMED