Math-LLMs: AI Cyberinfrastructure with Pre-trained Transformers for Math Education
International Journal of Artificial Intelligence in Education · 2025-06 · 35 (2) · 509-532
DOI: 10.1007/s40593-024-00416-y ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Artificial Intelligence in Education, 2025-06. Verfasst von Fan Zhang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 56 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
In recent years, the pre-training of Large Language Models (LLMs) in the educational domain has garnered significant attention. However, a discernible gap exists in the application of these models to mathematics education. This study aims to bridge this gap by pre-training LLMs on authentic K-12 mathematical dialogue datasets. Our research is structured around three primary research questions (RQs) that investigate the impact of fine-tuning data size and pre-training in downstream Natural Language Processing (NLP) tasks, and the efficacy of LLMs in text generation tasks within the mathematical context. Our findings indicate that data size plays a pivotal role in the performance of LLMs in downstream NLP tasks, with larger datasets yielding more consistent and improved results. Furthermore, pre-trained models consistently outperformed their non-pre-trained counterparts, emphasizing the importance of leveraging prior knowledge in LLMs. In the realm of text generation, we found that our model can not only enhance mathematical understanding and performance on downstream math tasks but also generate more engaging and human-like language.
Zitieren
APA
Zhang, F., Li, C., Henkel, O., Xing, W., Baral, S., Heffernan, N., & Li, H. (2025). Math-LLMs: AI Cyberinfrastructure with Pre-trained Transformers for Math Education. International Journal of Artificial Intelligence in Education, 35(2), 509-532. https://doi.org/10.1007/s40593-024-00416-y
Vancouver
Zhang F, Li C, Henkel O, Xing W, Baral S, Heffernan N, et al. Math-LLMs: AI Cyberinfrastructure with Pre-trained Transformers for Math Education. International Journal of Artificial Intelligence in Education. 2025;35(2):509-532. doi:10.1007/s40593-024-00416-y
BibTeX
@article{Zhang2025,
author = {Zhang, Fan and Li, Chenglu and Henkel, Owen and Xing, Wanli and Baral, Sami and Heffernan, Neil and Li, Hai},
title = {Math-LLMs: AI Cyberinfrastructure with Pre-trained Transformers for Math Education},
journal = {International Journal of Artificial Intelligence in Education},
year = {2025},
volume = {35},
number = {2},
pages = {509--532},
doi = {10.1007/s40593-024-00416-y}
}
EUVIMED