EUVIMEDEUVIMED entdecken
Crossref

Evolutionary Pre-Prompt Optimization for Mathematical Reasoning

Mathurin Videau, Alessandro Leite, Marc Schoenauer, Olivier Teytaud

ACM Transactions on Evolutionary Learning and Optimization · 16.03.2026

DOI: 10.1145/3797028 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Evolutionary Learning and Optimization, online erschienen am 16.03.2026. Verfasst von Mathurin Videau und 3 weiteren Autor:innen. Die Arbeit nennt 52 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent advancements have highlighted that large language models (LLMs), when given a small set of task-specific examples, demonstrate remarkable proficiency, a capability that extends to complex reasoning tasks. In particular, the combination of few-shot learning with the chain-of-thought (CoT) approach has been pivotal in steering models towards more logically consistent conclusions (Wei et al., 2022b). This paper explores the optimization of example selection for designing effective CoT pre-prompts and shows that the choice of the optimization algorithm, typically in favor of comparison-based methods such as evolutionary computation, significantly enhances efficacy and feasibility. Specifically, thanks to a limited exploitative and overfitted optimization, Evolutionary Pre-Prompt Optimization (EPPO) brings an improvement over the naive few-shot approach, exceeding 10 absolute points in exact match scores on benchmark datasets such as GSM8k and MathQA. These gains are consistent across various contexts and are further amplified when integrated with self-consistency (SC).

Zitieren

APA

Videau, M., Leite, A., Schoenauer, M., & Teytaud, O. (2026). Evolutionary Pre-Prompt Optimization for Mathematical Reasoning. ACM Transactions on Evolutionary Learning and Optimization. https://doi.org/10.1145/3797028

Vancouver

Videau M, Leite A, Schoenauer M, Teytaud O. Evolutionary Pre-Prompt Optimization for Mathematical Reasoning. ACM Transactions on Evolutionary Learning and Optimization. 2026. doi:10.1145/3797028

BibTeX
@article{Videau2026,
  author = {Videau, Mathurin and Leite, Alessandro and Schoenauer, Marc and Teytaud, Olivier},
  title = {Evolutionary Pre-Prompt Optimization for Mathematical Reasoning},
  journal = {ACM Transactions on Evolutionary Learning and Optimization},
  year = {2026},
  doi = {10.1145/3797028}
}
Kostenlos starten →