FGeo-Eval: Evaluation System for Plane Geometry Problem Solving
Symmetry · 07.06.2025 · 17 (6) · 902
DOI: 10.3390/sym17060902 ↗Kurz gefasst
Fachartikel in der Zeitschrift Symmetry, online erschienen am 07.06.2025. Verfasst von Qike Huang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Plane geometry problem solving has been a long-term challenge in mathematical reasoning and symbolic artificial intelligence. With the continued advancement of automated methods, the need for large-scale datasets and rigorous evaluation frameworks has become increasingly critical for benchmarking and guiding system development. However, existing resources often lack sufficient scale, systematic difficulty modeling, and quantifiable, process-based evaluation metrics. To address these limitations, we propose FGeo-Eval, a comprehensive evaluation system for plane geometry problem solving, and introduce the FormalGeo30K dataset, an extended dataset derived from FormalGeo7K. The evaluation system includes a problem completion rate metric PCR to assess partial progress, theorem weight computation to quantify knowledge importance, and a difficulty coefficient based on reasoning complexity. By analyzing problem structures and solution dependencies, this system enables fine-grained difficulty stratification and objective performance measurement. Concurrently, FormalGeo30K expands the dataset to 30,540 formally annotated problems, supporting more robust model training and evaluation. Experimental results demonstrate that the proposed metrics effectively evaluate problem difficulty and assess solver capabilities. With the augmented dataset, the average success rate across all difficulty levels for the FGeo-HyperGNet model increases from 77.43% to 85.01%, while the average PCR increases from 88.57% to 91.79%. These contributions provide essential infrastructure for advancing plane geometry reasoning systems, offering standardized benchmarks for model development and guiding optimization of geometry-solving models.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Huang, Q., Zhang, X., Zhu, N., Zhu, F., & Leng, T. (2025). FGeo-Eval: Evaluation System for Plane Geometry Problem Solving. Symmetry, 17(6), 902. https://doi.org/10.3390/sym17060902
Vancouver
Huang Q, Zhang X, Zhu N, Zhu F, Leng T. FGeo-Eval: Evaluation System for Plane Geometry Problem Solving. Symmetry. 2025;17(6):902. doi:10.3390/sym17060902
BibTeX
@article{Huang2025,
author = {Huang, Qike and Zhang, Xiaokai and Zhu, Na and Zhu, Fangzhen and Leng, Tuo},
title = {FGeo-Eval: Evaluation System for Plane Geometry Problem Solving},
journal = {Symmetry},
year = {2025},
volume = {17},
number = {6},
pages = {902},
doi = {10.3390/sym17060902}
}
EUVIMED