EUVIMEDEUVIMED entdecken
Crossref

HealthServe: A Public Health-Aware Inference Framework

Sicheng Zhou, Rohan Basu Roy

Proceedings of the ACM on Measurement and Analysis of Computing Systems · 29.05.2026 · 10 (2) · 1-26

DOI: 10.1145/3805638 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the ACM on Measurement and Analysis of Computing Systems, online erschienen am 29.05.2026. Verfasst von Sicheng Zhou und 1 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 71 Literaturangaben. Gefördert von: National Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large language model (LLM) inference consumes substantial datacenter energy and produces both carbon emissions and criteria pollutants (PM2.5, SO2, NOx). These criteria pollutants impact public health depending on the meteorological conditions of emission regions and population exposure. We apply health impact assessment to LLM inference, a use case of growing concern due to its rapidly rising energy consumption, and characterize health impacts from datacenter energy consumption as quantifiable health cost metrics. We then present HealthServe, a systems-level framework for health-aware LLM inference serving, which jointly minimizes carbon emissions and health costs across geo-distributed GPU clusters while meeting latency SLOs. HealthServe employs a hierarchical scheduling architecture with Social Cognitive Optimization (SCO) that maintains condition-indexed decision libraries for configuration reuse under recurring operating conditions. Evaluation on a heterogeneous GPU cluster across different U.S. datacenter locations demonstrates over 50% carbon footprint and over 25% health cost reductions over the state-of-the-art energy-aware LLM inference serving solutions. Additionally, we show that HealthServe can be augmented with existing carbon-aware serving approaches to provide additive sustainability benefits.

Förderung

  • National Science Foundation

Zitieren

APA

Zhou, S., & Roy, R. B. (2026). HealthServe: A Public Health-Aware Inference Framework. Proceedings of the ACM on Measurement and Analysis of Computing Systems, 10(2), 1-26. https://doi.org/10.1145/3805638

Vancouver

Zhou S, Roy RB. HealthServe: A Public Health-Aware Inference Framework. Proceedings of the ACM on Measurement and Analysis of Computing Systems. 2026;10(2):1-26. doi:10.1145/3805638

BibTeX
@article{Zhou2026,
  author = {Zhou, Sicheng and Roy, Rohan Basu},
  title = {HealthServe: A Public Health-Aware Inference Framework},
  journal = {Proceedings of the ACM on Measurement and Analysis of Computing Systems},
  year = {2026},
  volume = {10},
  number = {2},
  pages = {1--26},
  doi = {10.1145/3805638}
}
Kostenlos starten →