EUVIMEDOpdag EUVIMED
Crossref

Efficient LLM Serving for Agentic Workflows: A Data Systems Perspective

Noppanat Wadlom, Junyi Shen, Yao Lu

Proceedings of the ACM on Management of Data · 2026-05-18 · 4 (3) · 1-29

DOI: 10.1145/3802046 ↗

At a glance

Journal article in Proceedings of the ACM on Management of Data, published online on 2026-05-18. Written by Noppanat Wadlom and 2 co-authors. Cited 2 times so far (Crossref); 90 references.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Agentic workflows are composed of sequences of interdependent Large Language Model (LLM) calls, and they have become a dominant workload in modern AI systems. These workflows exhibit extensive redundancy from overlapping prompts and intermediate results due to speculative and parallel exploration. Existing LLM serving systems, such as vLLM, focus on optimizing individual inference calls and overlook cross-call dependencies, leading to significant inefficiencies. This paper rethinks LLM and agent serving from a data systems perspective and introduces Helium, a workflow-aware serving framework that models agentic workloads as query plans and treats LLM invocations as first-class operators. Helium integrates proactive caching and cache-aware scheduling to maximize reuse across prompts, KV states, and workflows. Through these techniques, Helium bridges classic query optimization principles with LLM serving, achieving up to 1.56× speedup over state-of-the-art agent serving systems on various workloads. Our results demonstrate that end-to-end optimization across workflows is essential for scalable and efficient LLM-based agents.

Cite

APA

Wadlom, N., Shen, J., & Lu, Y. (2026). Efficient LLM Serving for Agentic Workflows: A Data Systems Perspective. Proceedings of the ACM on Management of Data, 4(3), 1-29. https://doi.org/10.1145/3802046

Vancouver

Wadlom N, Shen J, Lu Y. Efficient LLM Serving for Agentic Workflows: A Data Systems Perspective. Proceedings of the ACM on Management of Data. 2026;4(3):1-29. doi:10.1145/3802046

BibTeX
@article{Wadlom2026,
  author = {Wadlom, Noppanat and Shen, Junyi and Lu, Yao},
  title = {Efficient LLM Serving for Agentic Workflows: A Data Systems Perspective},
  journal = {Proceedings of the ACM on Management of Data},
  year = {2026},
  volume = {4},
  number = {3},
  pages = {1--29},
  doi = {10.1145/3802046}
}
Start for free →