Prediction Efficiency Skill Scores for Event Detection Analysis
Space Weather · 2026-06 · 24 (6)
DOI: 10.1029/2025sw004848 ↗Kurz gefasst
Fachartikel in der Zeitschrift Space Weather, online erschienen am 03.06.2026. Verfasst von Michael W. Liemohn und 3 weiteren Autor:innen. Die Arbeit nennt 56 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: University of Alberta.
Abstract (Originalsprache)
Prediction efficiency (PE) is a skill score that compares the data‐model metric of mean square error against the variance of the observations (i.e., using the average of the observed values as the “reference model” in the general skill score formula). This has proven to be highly useful for analysis using “continuous metrics”—those data‐model comparison techniques that employ the exact values of the observations and model results—especially when comparing the new model's performance against an existing model. Another major grouping of data‐model comparisons is “event detection analysis” in which all observational and numerical values are converted into a binary yes‐no categorization of being in or out of “event state.” There is, however, no equivalent skill score to PE within the event detection toolkit. This study proposes two such options, one based on the proportion correct metric and another based on the critical success index metric. Like PE, these new skill scores use the observations as the reference model, which provides complete independence of the reference model from the new model. It is demonstrated, reevaluating two space weather data‐model comparison studies, that these skill scores provide context for model evaluation that is unique to other existing metrics and valuable for the assessment, especially with respect to comparing the new model's performance against an existing model. Reference models in existing skill scores are based in part on the new model's performance against the data, which leads to ambiguous interpretation for intermodel comparison usage.
Förderung
- University of Alberta
Zitieren
APA
Liemohn, M. W., Ganushkina, N. Y., Welling, D. T., & Azari, A. R. (2026). Prediction Efficiency Skill Scores for Event Detection Analysis. Space Weather, 24(6). https://doi.org/10.1029/2025sw004848
Vancouver
Liemohn MW, Ganushkina NY, Welling DT, Azari AR. Prediction Efficiency Skill Scores for Event Detection Analysis. Space Weather. 2026;24(6). doi:10.1029/2025sw004848
BibTeX
@article{Liemohn2026,
author = {Liemohn, Michael W. and Ganushkina, Natalia Yu. and Welling, Daniel T. and Azari, Abigail R.},
title = {Prediction Efficiency Skill Scores for Event Detection Analysis},
journal = {Space Weather},
year = {2026},
volume = {24},
number = {6},
doi = {10.1029/2025sw004848}
}
EUVIMED