EUVIMEDEUVIMED entdecken
Crossref

Change-Point-Aware Probabilistic Forecasting of Bursty LLM Demand with Conformal Intervals and Tail-Risk Control

Evan Hu

Stout in Mathematics and Statistics · 22.01.2026 · 2 (1) · 30-50

DOI: 10.61424/sq6x3p53 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Stout in Mathematics and Statistics, online erschienen am 22.01.2026. Verfasst von Evan Hu.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Short-horizon demand forecasts can support capacity reservation for large language model (LLM) services, but burstiness and regime change make both point accuracy and uncertainty calibration difficult. This study evaluates causal one-step-ahead forecasts on 1,429,737 BurstGPT records aggregated into 17,566 complete five-minute intervals. A chronological design used 12,384 intervals for training, 2,592 for conformal calibration, and 2,590 for held-out testing. Persistence, daily seasonal-naive, ARIMA, histogram gradient boosting (HGB), change-point-augmented HGB (CP-HGB), and a compact causal Transformer were compared. Raw quantiles, split conformalized quantile regression, rolling calibration, adaptive conformal inference (ACI), and a change-point-aware ACI reset (CP-ACI) were evaluated with pinball loss, coverage, width, Winkler score, capacity exceedance, and conditional value-at-risk (CVaR). The CP-HGB conditional median achieved the lowest point error, with an MAE of 17,912 tokens per interval and a 4.29% reduction relative to persistence. The compact Transformer’s raw 90% interval covered 83.09% of test outcomes; CP-ACI increased coverage to 90.12%. For a one-sided 95% CP-HGB capacity bound, CP-ACI attained 95.10% nonexceedance and reduced shortfall CVaR from 47,100 under ACI to 45,632 tokens, while increasing mean unused headroom from 59,126 to 60,306 tokens. Change resets were therefore most useful for correcting undercoverage and limiting upper-tail shortfall, whereas CP-HGB’s already conservative central interval gained little. The results support joint reporting of point error, calibration, sharpness, and tail risk when token workload is used as a capacity-planning proxy.

Zitieren

APA

Hu, E. (2026). Change-Point-Aware Probabilistic Forecasting of Bursty LLM Demand with Conformal Intervals and Tail-Risk Control. Stout in Mathematics and Statistics, 2(1), 30-50. https://doi.org/10.61424/sq6x3p53

Vancouver

Hu E. Change-Point-Aware Probabilistic Forecasting of Bursty LLM Demand with Conformal Intervals and Tail-Risk Control. Stout in Mathematics and Statistics. 2026;2(1):30-50. doi:10.61424/sq6x3p53

BibTeX
@article{Hu2026,
  author = {Hu, Evan},
  title = {Change-Point-Aware Probabilistic Forecasting of Bursty LLM Demand with Conformal Intervals and Tail-Risk Control},
  journal = {Stout in Mathematics and Statistics},
  year = {2026},
  volume = {2},
  number = {1},
  pages = {30--50},
  doi = {10.61424/sq6x3p53}
}
Kostenlos starten →