EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Exploring Large Language Models for University-Level Mathematics: A Comparative Study

Fan Yang, Wanwan Xia, Wenting Qin

Mathematics · 29.05.2026 · 14 (11) · 1886

DOI: 10.3390/math14111886 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Mathematics, online erschienen am 29.05.2026. Verfasst von Fan Yang und 2 weiteren Autor:innen. Die Arbeit nennt 60 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: JIANGSU PROVINCE HIGHER EDUCATION “HIGH-QUALITY PUBLIC COURSE TEACHING REFORM RESEARCH” SPECIAL PROJECT, NANJING TECH UNIVERSITY KEY GENERAL PUBLIC BASIC COURSE REFORM PROJECT.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large language models (LLMs) have shown great potential in solving complex mathematical problems, but their performance in university-level mathematics is still underexplored. This study provides a systematic evaluation of eleven state-of-the-art LLMs on five core undergraduate mathematics courses. An end-to-end automated pipeline is proposed for solution inference and answer evaluation, including a reliable ensemble evaluation scheme using seven reasoning-enabled LLMs as expert evaluators. The experimental results show that reasoning models outperform non-reasoning ones significantly, with DeepSeek-V3.2 and Kimi-K2.5 achieving average scores of 88.24 and 88.99, respectively. Under the conditions of the conducted experiment in this study, DeepSeek-V3.2 achieves the most reasonable accuracy–cost trade-off. This work reveals the strengths and limitations of modern LLMs in advanced mathematical reasoning and provides insights into their application in AI mathematical education.

Förderung

  • JIANGSU PROVINCE HIGHER EDUCATION “HIGH-QUALITY PUBLIC COURSE TEACHING REFORM RESEARCH” SPECIAL PROJECT
  • NANJING TECH UNIVERSITY KEY GENERAL PUBLIC BASIC COURSE REFORM PROJECT

Zitieren

APA

Yang, F., Xia, W., & Qin, W. (2026). Exploring Large Language Models for University-Level Mathematics: A Comparative Study. Mathematics, 14(11), 1886. https://doi.org/10.3390/math14111886

Vancouver

Yang F, Xia W, Qin W. Exploring Large Language Models for University-Level Mathematics: A Comparative Study. Mathematics. 2026;14(11):1886. doi:10.3390/math14111886

BibTeX
@article{Yang2026,
  author = {Yang, Fan and Xia, Wanwan and Qin, Wenting},
  title = {Exploring Large Language Models for University-Level Mathematics: A Comparative Study},
  journal = {Mathematics},
  year = {2026},
  volume = {14},
  number = {11},
  pages = {1886},
  doi = {10.3390/math14111886}
}
Kostenlos starten →