EUVIMEDEUVIMED entdecken
Crossref

Evaluating the problem-solving capabilities of modern Large Language Models in competitive programming

Mirel Coșulschi, Mihai Gabroveanu, Alexandra Vultureanu-Albiși, Florin Slabu

Annals of the University of Craiova Mathematics and Computer Science Series · 30.06.2026 · 53 (1) · 310-330

DOI: 10.52846/ami.v53i1.2394 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Annals of the University of Craiova Mathematics and Computer Science Series, online erschienen am 30.06.2026. Verfasst von Mirel Coșulschi und 3 weiteren Autor:innen. Die Arbeit nennt 27 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper investigates performance on a dataset of 40 competitive programming tasks designed for formal evaluation in educational settings. The primary objective is to analyze how the performance of problem-solving varies between tasks with differing structure, difficulty, and source, using partial acceptance automated test-based scoring. By examining aggregate performance metrics, task-level difficulty, acceptance rates, failure patterns, and discriminative properties, the study characterizes which types of problem are consistently solvable, which remain challenging, and which most effectively differentiate levels of problem-solving capability. The results reveal substantial variation across tasks, highlighting the influence of task difficulty and structure on acceptance outcomes and demonstrating that medium-difficulty problems tend to provide the strongest discrimination. These findings contribute empirical insight into the characteristics of formally designed Olympiad-style programming problems and their suitability for structured performance assessment in educational and competitive programming contexts.

Zitieren

APA

Coșulschi, M., Gabroveanu, M., Vultureanu-Albiși, A., & Slabu, F. (2026). Evaluating the problem-solving capabilities of modern Large Language Models in competitive programming. Annals of the University of Craiova Mathematics and Computer Science Series, 53(1), 310-330. https://doi.org/10.52846/ami.v53i1.2394

Vancouver

Coșulschi M, Gabroveanu M, Vultureanu-Albiși A, Slabu F. Evaluating the problem-solving capabilities of modern Large Language Models in competitive programming. Annals of the University of Craiova Mathematics and Computer Science Series. 2026;53(1):310-330. doi:10.52846/ami.v53i1.2394

BibTeX
@article{Coulschi2026,
  author = {Coșulschi, Mirel and Gabroveanu, Mihai and Vultureanu-Albiși, Alexandra and Slabu, Florin},
  title = {Evaluating the problem-solving capabilities of modern Large Language Models in competitive programming},
  journal = {Annals of the University of Craiova Mathematics and Computer Science Series},
  year = {2026},
  volume = {53},
  number = {1},
  pages = {310--330},
  doi = {10.52846/ami.v53i1.2394}
}
Kostenlos starten →