Evolutionary Pre-Prompt Optimization for Mathematical Reasoning
ACM Transactions on Evolutionary Learning and Optimization · 16.03.2026
DOI: 10.1145/3797028 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Evolutionary Learning and Optimization, online erschienen am 16.03.2026. Verfasst von Mathurin Videau und 3 weiteren Autor:innen. Die Arbeit nennt 52 Literaturangaben.
Abstract (Originalsprache)
Recent advancements have highlighted that large language models (LLMs), when given a small set of task-specific examples, demonstrate remarkable proficiency, a capability that extends to complex reasoning tasks. In particular, the combination of few-shot learning with the chain-of-thought (CoT) approach has been pivotal in steering models towards more logically consistent conclusions (Wei et al., 2022b). This paper explores the optimization of example selection for designing effective CoT pre-prompts and shows that the choice of the optimization algorithm, typically in favor of comparison-based methods such as evolutionary computation, significantly enhances efficacy and feasibility. Specifically, thanks to a limited exploitative and overfitted optimization, Evolutionary Pre-Prompt Optimization (EPPO) brings an improvement over the naive few-shot approach, exceeding 10 absolute points in exact match scores on benchmark datasets such as GSM8k and MathQA. These gains are consistent across various contexts and are further amplified when integrated with self-consistency (SC).
Zitieren
APA
Videau, M., Leite, A., Schoenauer, M., & Teytaud, O. (2026). Evolutionary Pre-Prompt Optimization for Mathematical Reasoning. ACM Transactions on Evolutionary Learning and Optimization. https://doi.org/10.1145/3797028
Vancouver
Videau M, Leite A, Schoenauer M, Teytaud O. Evolutionary Pre-Prompt Optimization for Mathematical Reasoning. ACM Transactions on Evolutionary Learning and Optimization. 2026. doi:10.1145/3797028
BibTeX
@article{Videau2026,
author = {Videau, Mathurin and Leite, Alessandro and Schoenauer, Marc and Teytaud, Olivier},
title = {Evolutionary Pre-Prompt Optimization for Mathematical Reasoning},
journal = {ACM Transactions on Evolutionary Learning and Optimization},
year = {2026},
doi = {10.1145/3797028}
}
EUVIMED