EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Evaluation of short-term multi-target respiratory forecasts over winter 2024-25 in England using sub-ensemble contribution analyses

Jack Kennedy iD, William Ferguson, Owen Jones iD, Steven Riley, Thomas Ward, Maria L Tang, Jonathon Mellor

PLOS Computational Biology · 2026

DOI: 10.1371/journal.pcbi.1014644 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS Computational Biology, 2026. Verfasst von Jack Kennedy und 6 weiteren Autor:innen. Beteiligte Einrichtung: UK Health Security Agency, London, United Kingdom. Hauptthemen laut MEDLINE: COVID-19, Influenza, Human. Die Arbeit nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Epidemic forecasting research often assesses ensembles and their component models using probabilistic scoring rules. Quantifying how individual models affect ensemble performance is challenging, particularly across multiple targets and spatial scales.

Methods

We present Winter 2024–25 forecasts of Influenza and COVID-19 hospital admissions in England and conduct a retrospective simulation using the operational component models. Forecasts were scored using the per capita weighted interval score (pcWIS) for counts and the ranked probability score (RPS) for ordinal trend direction. We compared retrospective forecasts, used generalised additive models (GAMs) to estimate the expected change in score from the inclusion of a model in a sub-ensemble (an ensemble formed from a subset of available models), and used Pareto analysis to understand which sub-ensembles were Pareto-optimal across scoring rules.

Results

Nationally, there was a 47% improvement in Influenza pcWIS versus sub-ensembles. However, Influenza operational ensembles were on average 22% worse than sub-ensembles, when measured by RPS. For COVID-19, operational ensembles were 43% and 280% worse on average, than retrospective sub-ensembles by pcWIS and RPS, respectively. However, COVID-19 operational ensembles were on average 2% (pcWIS) and 13% (RPS) better than individual operational models. For influenza, operational ensembles were, on average, 58% (pcWIS) and 41% (RPS) better than individual models. The sub-ensemble simulation showed how individual models influenced the ensemble scores during different epidemic phases. The Pareto analysis demonstrated that there can be a trade-off between relative direction and absolute count score optimisation.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

COVID-19Influenza, HumanEnglandHumansSeasonsForecastingSARS-CoV-2Retrospective StudiesPandemicsModels, StatisticalComputer SimulationComputational BiologyHospitalization

Autor:innen und Institutionen

  • UK Health Security Agency, London, United Kingdom.
  • School of Public Health, Imperial College London, London, United Kingdom.

ORCID-Profile: Jack Kennedy, Owen Jones

Zitieren

APA

Kennedy, J., Ferguson, W., Jones, O., Riley, S., Ward, T., Tang, M. L., & Mellor, J. (2026). Evaluation of short-term multi-target respiratory forecasts over winter 2024-25 in England using sub-ensemble contribution analyses. PLOS Computational Biology. https://doi.org/10.1371/journal.pcbi.1014644

Vancouver

Kennedy J, Ferguson W, Jones O, Riley S, Ward T, Tang ML, et al. Evaluation of short-term multi-target respiratory forecasts over winter 2024-25 in England using sub-ensemble contribution analyses. PLOS Computational Biology. 2026. doi:10.1371/journal.pcbi.1014644

BibTeX
@article{Kennedy2026,
  author = {Kennedy, Jack and Ferguson, William and Jones, Owen and Riley, Steven and Ward, Thomas and Tang, Maria L and Mellor, Jonathon},
  title = {Evaluation of short-term multi-target respiratory forecasts over winter 2024-25 in England using sub-ensemble contribution analyses},
  journal = {PLOS Computational Biology},
  year = {2026},
  doi = {10.1371/journal.pcbi.1014644}
}
Kostenlos starten →