HealthServe: A Public Health-Aware Inference Framework
ACM SIGMETRICS Performance Evaluation Review · 20.07.2026 · 54 (1) · 100-102
DOI: 10.1145/3820171.3806868 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM SIGMETRICS Performance Evaluation Review, online erschienen am 27.07.2026. Verfasst von Sicheng Zhou und 1 weiteren Autor:innen. Die Arbeit nennt 3 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science Foundation.
Abstract (Originalsprache)
Large language model (LLM) inference consumes substantial datacenter energy and produces both carbon emissions and criteria pollutants (PM2.5, SO2, NOx). These criteria pollutants impact public health depending on the meteorological conditions of emission regions and population exposure. We apply health impact assessment to LLM inference, a use case of growing concern due to its rapidly rising energy consumption, and characterize health impacts from datacenter energy consumption as quantifiable health cost metrics. We then present HealthServe, a systems-level framework for health-aware LLM inference serving, which jointly minimizes carbon emissions and health costs across geo-distributed GPU clusters while meeting latency SLOs. HealthServe employs a hierarchical scheduling architecture with Social Cognitive Optimization (SCO) that maintains condition-indexed decision libraries for configuration reuse under recurring operating conditions. Evaluation on a heterogeneous GPU cluster across different U.S. datacenter locations demonstrates over 50% carbon footprint and over 25% health cost reductions over the state-of-the-art energy-aware LLM inference serving solutions. Additionally, we show that HealthServe can be augmented with existing carbon-aware serving approaches to provide additive sustainability benefits.
Förderung
- National Science Foundation
Zitieren
APA
Zhou, S., & Roy, R. B. (2026). HealthServe: A Public Health-Aware Inference Framework. ACM SIGMETRICS Performance Evaluation Review, 54(1), 100-102. https://doi.org/10.1145/3820171.3806868
Vancouver
Zhou S, Roy RB. HealthServe: A Public Health-Aware Inference Framework. ACM SIGMETRICS Performance Evaluation Review. 2026;54(1):100-102. doi:10.1145/3820171.3806868
BibTeX
@article{Zhou2026,
author = {Zhou, Sicheng and Roy, Rohan Basu},
title = {HealthServe: A Public Health-Aware Inference Framework},
journal = {ACM SIGMETRICS Performance Evaluation Review},
year = {2026},
volume = {54},
number = {1},
pages = {100--102},
doi = {10.1145/3820171.3806868}
}
EUVIMED