A Unifying Framework for Probabilistic Validation Metrics
Journal of Verification, Validation and Uncertainty Quantification · 01.09.2019 · 4 (3)
DOI: 10.1115/1.4045296 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Verification, Validation and Uncertainty Quantification, online erschienen am 25.11.2019. Verfasst von Paul Gardner und 2 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 36 Literaturangaben. Gefördert von: Engineering and Physical Sciences Research Council.
Abstract (Originalsprache)
Probabilistic modeling methods are increasingly being employed in engineering applications. These approaches make inferences about the distribution for output quantities of interest. A challenge in applying probabilistic computer models (simulators) is validating output distributions against samples from observational data. An ideal validation metric is one that intuitively provides information on key differences between the simulator output and observational distributions, such as statistical distances/divergences. Within the literature, only a small set of statistical distances/divergences have been utilized for this task; often selected based on user experience and without reference to the wider variety available. As a result, this paper offers a unifying framework of statistical distances/divergences, categorizing those implemented within the literature, providing a greater understanding of their benefits, and offering new potential measures as validation metrics. In this paper, two families of measures for quantifying differences between distributions, that encompass the existing statistical distances/divergences within the literature, are analyzed: f-divergence and integral probability metrics (IPMs). Specific measures from these families are highlighted, providing an assessment of current and new validation metrics, with a discussion of their merits in determining simulator adequacy, offering validation metrics with greater sensitivity in quantifying differences across the range of probability mass.
Förderung
- Engineering and Physical Sciences Research Council
Zitieren
APA
Gardner, P., Lord, C., & Barthorpe, R. J. (2019). A Unifying Framework for Probabilistic Validation Metrics. Journal of Verification, Validation and Uncertainty Quantification, 4(3). https://doi.org/10.1115/1.4045296
Vancouver
Gardner P, Lord C, Barthorpe RJ. A Unifying Framework for Probabilistic Validation Metrics. Journal of Verification, Validation and Uncertainty Quantification. 2019;4(3). doi:10.1115/1.4045296
BibTeX
@article{Gardner2019,
author = {Gardner, Paul and Lord, Charles and Barthorpe, Robert J.},
title = {A Unifying Framework for Probabilistic Validation Metrics},
journal = {Journal of Verification, Validation and Uncertainty Quantification},
year = {2019},
volume = {4},
number = {3},
doi = {10.1115/1.4045296}
}
EUVIMED