Toward a New Framework to Evaluate Process‐Based Model Configurations and Quantify Data Worth Prior to Calibration
Water Resources Research · 2025-09 · 61 (9)
DOI: 10.1029/2025wr040323 ↗Kurz gefasst
Fachartikel in der Zeitschrift Water Resources Research, online erschienen am 13.09.2025. Verfasst von Mark S. Pleasants und 5 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: U.S. Geological Survey.
Abstract (Originalsprache)
Model criticism, discrimination, and selection methods often rely on calibrated model outputs. Because calibration can be computationally expensive, model criticism can first be undertaken by assessing model outputs obtained from limited prior parameter ensembles. However, such prior‐based methods are often heuristic and do not formalize the notion of balancing model consistency with data and model complexity (i.e., model adequacy). We present a new framework to discriminate among candidate models prior to calibration that formalizes prior‐to‐calibration model adequacy into a metric to implicitly balance prior model output data coverage with model complexity represented by prior output (co)variance. The prior model adequacy metric “Mahalanobis distance deviation” quantifies the deviation of (a) the set of squared Mahalanobis distances of data from a prior model output distribution from (b) the set of squared Mahalanobis distances of data from their own distribution. A new data worth metric “discernment value” is also presented which quantifies the value of data for screening less‐adequate models prior to calibration. Discernment value is calculated from the change in variance of a weighted average of prior model outputs from all candidate models due to less‐adequate model outputs receiving lower weight. The framework is demonstrated using a one‐dimensional groundwater flow model with eight possible configurations. A synthetic data network is used to test the framework. Results show the framework identifies the candidate models most similar to the true model used to create the synthetic data. Discernment values show variation in the value of different data types and locations for screening less‐adequate models.
Förderung
- U.S. Geological Survey
Zitieren
APA
Pleasants, M. S., Fienen, M. N., Essaid, H. I., Blomquist, J. D., Yang, J., & Ye, M. (2025). Toward a New Framework to Evaluate Process‐Based Model Configurations and Quantify Data Worth Prior to Calibration. Water Resources Research, 61(9). https://doi.org/10.1029/2025wr040323
Vancouver
Pleasants MS, Fienen MN, Essaid HI, Blomquist JD, Yang J, Ye M. Toward a New Framework to Evaluate Process‐Based Model Configurations and Quantify Data Worth Prior to Calibration. Water Resources Research. 2025;61(9). doi:10.1029/2025wr040323
BibTeX
@article{Pleasants2025,
author = {Pleasants, Mark S. and Fienen, Michael N. and Essaid, Hedeff I. and Blomquist, Joel D. and Yang, Jing and Ye, Ming},
title = {Toward a New Framework to Evaluate Process‐Based Model Configurations and Quantify Data Worth Prior to Calibration},
journal = {Water Resources Research},
year = {2025},
volume = {61},
number = {9},
doi = {10.1029/2025wr040323}
}
EUVIMED