Evaluating chatGPT-4 and chatGPT-4o: performance insights from NAEP mathematics problem solving
Frontiers in Education · 18.09.2024 · 9
DOI: 10.3389/feduc.2024.1452570 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Education, online erschienen am 18.09.2024. Verfasst von Xin Wei. Die Arbeit wurde bisher 26-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Institute of Education Sciences.
Abstract (Originalsprache)
This study assesses the capabilities of OpenAI’s ChatGPT-4 and ChatGPT-4o in solving mathematics problems from the National Assessment of Educational Progress (NAEP) across grades 4, 8, and 12. Results indicate that ChatGPT-4o slightly outperform ChatGPT-4 and both models generally surpass U.S. students’ performance across all grades, content areas, item type, and difficulty level. However, both models perform worse on geometry and measurement than on algebra and face more difficulties with high-difficulty mathematics items. This investigation highlights the strengths and limitations of AI as a supplementary educational tool, pinpointing areas for improvement in spatial intelligence and complex mathematical problem-solving. These findings suggest that while AI has the potential to support instruction in specific mathematical areas like algebra, there remains a need for careful integration and teacher-mediated strategies in areas where AI is less effective.
Förderung
- Institute of Education Sciences
Zitieren
APA
Wei, X. (2024). Evaluating chatGPT-4 and chatGPT-4o: performance insights from NAEP mathematics problem solving. Frontiers in Education, 9. https://doi.org/10.3389/feduc.2024.1452570
Vancouver
Wei X. Evaluating chatGPT-4 and chatGPT-4o: performance insights from NAEP mathematics problem solving. Frontiers in Education. 2024;9. doi:10.3389/feduc.2024.1452570
BibTeX
@article{Wei2024,
author = {Wei, Xin},
title = {Evaluating chatGPT-4 and chatGPT-4o: performance insights from NAEP mathematics problem solving},
journal = {Frontiers in Education},
year = {2024},
volume = {9},
doi = {10.3389/feduc.2024.1452570}
}
EUVIMED