Ensemble size dependence of the logarithmic score for forecasts issued as multivariate normal distributions
Quarterly Journal of the Royal Meteorological Society · 2025-01 · 151 (766)
DOI: 10.1002/qj.4898 ↗Kurz gefasst
Fachartikel in der Zeitschrift Quarterly Journal of the Royal Meteorological Society, online erschienen am 25.11.2024. Verfasst von Martin Leutbecher und 1 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Nemzeti Kutatási Fejlesztési és Innovációs Hivatal.
Abstract (Originalsprache)
Multivariate probabilistic verification is concerned with the evaluation of joint probability distributions of vector quantities such as a weather variable at multiple locations or a wind vector for instance. The logarithmic score (also known as ignorance score) is a proper score that is useful in this context. In order to apply the logarithmic score to ensemble forecasts, a choice for the density is required. Here, we are interested in the specific case when the density is multivariate normal with mean and covariance given by the ensemble mean and ensemble covariance respectively. Under the assumptions of multivariate normality and exchangeability of the ensemble members, a relationship is derived that describes how the logarithmic score depends on ensemble size. It permits one to estimate the score in the limit of infinite ensemble size from a small ensemble and thus produces a fair logarithmic score for multivariate ensemble forecasts under the assumption of normality. This generalises a study from 2018 that derived the ensemble size adjustment of the logarithmic score in the univariate case. An application to medium‐range forecasts examines the usefulness of the ensemble size adjustments when multivariate normality is only an approximation. Predictions of vectors consisting of several different combinations of upper air variables are considered. Logarithmic scores are calculated for these vectors using ECMWF's daily extended‐range forecasts, which consist of a 100‐member ensemble. The probabilistic forecasts of these vectors are verified against operational European Centre for Medium‐Range Weather Forecasts (ECMWF) analyses in the northern midlatitudes in autumn 2023. Scores are computed for ensemble sizes from 8 to 100. The fair logarithmic scores of ensembles with different cardinalities are very close, in contrast to the unadjusted scores, which decrease considerably with ensemble size. This provides evidence for the practical usefulness of the relationships derived.
Förderung
- Nemzeti Kutatási Fejlesztési és Innovációs Hivatal
Zitieren
APA
Leutbecher, M., & Baran, S. (2025). Ensemble size dependence of the logarithmic score for forecasts issued as multivariate normal distributions. Quarterly Journal of the Royal Meteorological Society, 151(766). https://doi.org/10.1002/qj.4898
Vancouver
Leutbecher M, Baran S. Ensemble size dependence of the logarithmic score for forecasts issued as multivariate normal distributions. Quarterly Journal of the Royal Meteorological Society. 2025;151(766). doi:10.1002/qj.4898
BibTeX
@article{Leutbecher2025,
author = {Leutbecher, Martin and Baran, Sándor},
title = {Ensemble size dependence of the logarithmic score for forecasts issued as multivariate normal distributions},
journal = {Quarterly Journal of the Royal Meteorological Society},
year = {2025},
volume = {151},
number = {766},
doi = {10.1002/qj.4898}
}
EUVIMED