EUVIMEDEUVIMED entdecken
Crossref

LLM Cost Autopilot: Intelligent AI Model Routing for Cost Optimization – A Survey of Cost-Aware LLM Routing Techniques and Proposed Architecture

Bhavya R. Patel, Rupal M. Meshram, Isha M. Saxena, Chaitali P. Jawale, Prof. Shubangi Deshmukh

International Journal of Advanced Research in Science Communication and Technology · 17.11.2026 · 140

DOI: 10.48175/ijarsct-40817 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Advanced Research in Science Communication and Technology, online erschienen am 17.11.2026. Verfasst von Bhavya R. Patel und 4 weiteren Autor:innen. Die Arbeit nennt 12 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large Language Models (LLMs) provide strong capabilities across reasoning, coding, knowledge retrieval, and generation, but API usage becomes expensive when every request is routed to a high-cost model. The central problem is choosing an adequate model and inference strategy for each request while balancing quality, cost, latency, and operational constraints. This paper surveys twelve studies spanning unified routing infrastructure, benchmark design, cost-aware selection, preference-based routing, resource-aware serving, output-budget control, batching, cascading, quality-aware routing, adaptive test-time compute, and online routing with user feedback. The literature indicates a shift from static model choice toward multi-objective and adaptive routing. A practical gap remains for a lightweight, transparent, configurable application-level cost controller for small multi-provider applications. To address this, the paper proposes LLM Cost Autopilot, combining query analysis, explicit cost/capability rules, response caching, multi-provider model invocation, and cost/performance observability with an evaluation framework. No experimental results for the proposed system are claimed; it is presented as an implementation-oriented baseline for future extensions. Index Terms—LLM routing, cost optimization, cost-aware routing, model selection, response caching, token usage, latency, multi-model serving, adaptive compute, user satisfaction, AI cost monitoring.

Zitieren

APA

Patel, B. R., Meshram, R. M., Saxena, I. M., Jawale, C. P., & Deshmukh, P. S. (2026). LLM Cost Autopilot: Intelligent AI Model Routing for Cost Optimization – A Survey of Cost-Aware LLM Routing Techniques and Proposed Architecture. International Journal of Advanced Research in Science Communication and Technology, 140. https://doi.org/10.48175/ijarsct-40817

Vancouver

Patel BR, Meshram RM, Saxena IM, Jawale CP, Deshmukh PS. LLM Cost Autopilot: Intelligent AI Model Routing for Cost Optimization – A Survey of Cost-Aware LLM Routing Techniques and Proposed Architecture. International Journal of Advanced Research in Science Communication and Technology. 2026:140. doi:10.48175/ijarsct-40817

BibTeX
@article{Patel2026,
  author = {Patel, Bhavya R. and Meshram, Rupal M. and Saxena, Isha M. and Jawale, Chaitali P. and Deshmukh, Prof. Shubangi},
  title = {LLM Cost Autopilot: Intelligent AI Model Routing for Cost Optimization – A Survey of Cost-Aware LLM Routing Techniques and Proposed Architecture},
  journal = {International Journal of Advanced Research in Science Communication and Technology},
  year = {2026},
  pages = {140},
  doi = {10.48175/ijarsct-40817}
}
Kostenlos starten →