Exploring Large Language Models for University-Level Mathematics: A Comparative Study
Mathematics · 29.05.2026 · 14 (11) · 1886
DOI: 10.3390/math14111886 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mathematics, online erschienen am 29.05.2026. Verfasst von Fan Yang und 2 weiteren Autor:innen. Die Arbeit nennt 60 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: JIANGSU PROVINCE HIGHER EDUCATION “HIGH-QUALITY PUBLIC COURSE TEACHING REFORM RESEARCH” SPECIAL PROJECT, NANJING TECH UNIVERSITY KEY GENERAL PUBLIC BASIC COURSE REFORM PROJECT.
Abstract (Originalsprache)
Large language models (LLMs) have shown great potential in solving complex mathematical problems, but their performance in university-level mathematics is still underexplored. This study provides a systematic evaluation of eleven state-of-the-art LLMs on five core undergraduate mathematics courses. An end-to-end automated pipeline is proposed for solution inference and answer evaluation, including a reliable ensemble evaluation scheme using seven reasoning-enabled LLMs as expert evaluators. The experimental results show that reasoning models outperform non-reasoning ones significantly, with DeepSeek-V3.2 and Kimi-K2.5 achieving average scores of 88.24 and 88.99, respectively. Under the conditions of the conducted experiment in this study, DeepSeek-V3.2 achieves the most reasonable accuracy–cost trade-off. This work reveals the strengths and limitations of modern LLMs in advanced mathematical reasoning and provides insights into their application in AI mathematical education.
Förderung
- JIANGSU PROVINCE HIGHER EDUCATION “HIGH-QUALITY PUBLIC COURSE TEACHING REFORM RESEARCH” SPECIAL PROJECT
- NANJING TECH UNIVERSITY KEY GENERAL PUBLIC BASIC COURSE REFORM PROJECT
Zitieren
APA
Yang, F., Xia, W., & Qin, W. (2026). Exploring Large Language Models for University-Level Mathematics: A Comparative Study. Mathematics, 14(11), 1886. https://doi.org/10.3390/math14111886
Vancouver
Yang F, Xia W, Qin W. Exploring Large Language Models for University-Level Mathematics: A Comparative Study. Mathematics. 2026;14(11):1886. doi:10.3390/math14111886
BibTeX
@article{Yang2026,
author = {Yang, Fan and Xia, Wanwan and Qin, Wenting},
title = {Exploring Large Language Models for University-Level Mathematics: A Comparative Study},
journal = {Mathematics},
year = {2026},
volume = {14},
number = {11},
pages = {1886},
doi = {10.3390/math14111886}
}
EUVIMED