EUVIMEDEUVIMED entdecken
Crossref

TightLLM: Maximizing Throughput for LLM Inference via Adaptive Offloading Policy

Yitao Hu, Xiulong Liu, Guotao Yang, Linxuan Li, Kai Zeng, Zhixin Zhao, Sheng Chen, Laiping Zhao, Wenxin Li, Keqiu Li

IEEE Transactions on Computers · 2025-07 · 74 (7) · 2195-2209

DOI: 10.1109/tc.2025.3558009 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Computers, 2025-07. Verfasst von Yitao Hu und 9 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 42 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Kein Abstract verfügbar.

Förderung

  • National Key Research and Development Program of China
  • National Natural Science Foundation of China

Zitieren

APA

Hu, Y., Liu, X., Yang, G., Li, L., Zeng, K., Zhao, Z., Chen, S., Zhao, L., Li, W., & Li, K. (2025). TightLLM: Maximizing Throughput for LLM Inference via Adaptive Offloading Policy. IEEE Transactions on Computers, 74(7), 2195-2209. https://doi.org/10.1109/tc.2025.3558009

Vancouver

Hu Y, Liu X, Yang G, Li L, Zeng K, Zhao Z, et al. TightLLM: Maximizing Throughput for LLM Inference via Adaptive Offloading Policy. IEEE Transactions on Computers. 2025;74(7):2195-2209. doi:10.1109/tc.2025.3558009

BibTeX
@article{Hu2025,
  author = {Hu, Yitao and Liu, Xiulong and Yang, Guotao and Li, Linxuan and Zeng, Kai and Zhao, Zhixin and Chen, Sheng and Zhao, Laiping and Li, Wenxin and Li, Keqiu},
  title = {TightLLM: Maximizing Throughput for LLM Inference via Adaptive Offloading Policy},
  journal = {IEEE Transactions on Computers},
  year = {2025},
  volume = {74},
  number = {7},
  pages = {2195--2209},
  doi = {10.1109/tc.2025.3558009}
}
Kostenlos starten →