Benchmarking Large Language Models on Network Optimization
Operations Research and Applications : An International Journal · 28.05.2025 · 12 (2) · 01-17
DOI: 10.5121/oraj.2025.12201 ↗Kurz gefasst
Fachartikel in der Zeitschrift Operations Research and Applications : An International Journal, online erschienen am 28.05.2025. Verfasst von Ethan Cui. Die Arbeit wurde bisher 1-mal zitiert (Crossref).
Abstract (Originalsprache)
The most recent large language models (LLMs) have impressive problem-solving capabilities in tasks such as code generation and completing math problems. However, a majority of current benchmarks on recent LLMs test only on academic or competition style questions, leading to gaps in our understanding of the capabilities of LLMs. This paper introduces the first benchmark that evaluates LLMs on network optimization problems from operations research, including shortest-path routing, min-cost flow, and multicommodity flow. Such problems test LLM’s abilities to both follow structured instructions and conforming to complex constraints along with long-term reasoning on complex tasks. By controlling the complexity of synthetically generated instances, we reveal critical differences in the reasoning and planning capabilities of seven frontier models. Our work bridges the Operations Research (OR) and LLM communities, positioning network optimization as a rigorous and scalable framework for evaluating and advancing LLM reasoning.
Zitieren
APA
Cui, E. (2025). Benchmarking Large Language Models on Network Optimization. Operations Research and Applications : An International Journal, 12(2), 01-17. https://doi.org/10.5121/oraj.2025.12201
Vancouver
Cui E. Benchmarking Large Language Models on Network Optimization. Operations Research and Applications : An International Journal. 2025;12(2):01-17. doi:10.5121/oraj.2025.12201
BibTeX
@article{Cui2025,
author = {Cui, Ethan},
title = {Benchmarking Large Language Models on Network Optimization},
journal = {Operations Research and Applications : An International Journal},
year = {2025},
volume = {12},
number = {2},
pages = {01--17},
doi = {10.5121/oraj.2025.12201}
}
EUVIMED