EUVIMEDEUVIMED entdecken
Crossref

A Unifying Framework for Probabilistic Validation Metrics

Paul Gardner, Charles Lord, Robert J. Barthorpe

Journal of Verification, Validation and Uncertainty Quantification · 01.09.2019 · 4 (3)

DOI: 10.1115/1.4045296 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Verification, Validation and Uncertainty Quantification, online erschienen am 25.11.2019. Verfasst von Paul Gardner und 2 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 36 Literaturangaben. Gefördert von: Engineering and Physical Sciences Research Council.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Probabilistic modeling methods are increasingly being employed in engineering applications. These approaches make inferences about the distribution for output quantities of interest. A challenge in applying probabilistic computer models (simulators) is validating output distributions against samples from observational data. An ideal validation metric is one that intuitively provides information on key differences between the simulator output and observational distributions, such as statistical distances/divergences. Within the literature, only a small set of statistical distances/divergences have been utilized for this task; often selected based on user experience and without reference to the wider variety available. As a result, this paper offers a unifying framework of statistical distances/divergences, categorizing those implemented within the literature, providing a greater understanding of their benefits, and offering new potential measures as validation metrics. In this paper, two families of measures for quantifying differences between distributions, that encompass the existing statistical distances/divergences within the literature, are analyzed: f-divergence and integral probability metrics (IPMs). Specific measures from these families are highlighted, providing an assessment of current and new validation metrics, with a discussion of their merits in determining simulator adequacy, offering validation metrics with greater sensitivity in quantifying differences across the range of probability mass.

Förderung

  • Engineering and Physical Sciences Research Council

Zitieren

APA

Gardner, P., Lord, C., & Barthorpe, R. J. (2019). A Unifying Framework for Probabilistic Validation Metrics. Journal of Verification, Validation and Uncertainty Quantification, 4(3). https://doi.org/10.1115/1.4045296

Vancouver

Gardner P, Lord C, Barthorpe RJ. A Unifying Framework for Probabilistic Validation Metrics. Journal of Verification, Validation and Uncertainty Quantification. 2019;4(3). doi:10.1115/1.4045296

BibTeX
@article{Gardner2019,
  author = {Gardner, Paul and Lord, Charles and Barthorpe, Robert J.},
  title = {A Unifying Framework for Probabilistic Validation Metrics},
  journal = {Journal of Verification, Validation and Uncertainty Quantification},
  year = {2019},
  volume = {4},
  number = {3},
  doi = {10.1115/1.4045296}
}
Kostenlos starten →