Statistical Verification using Surrogate Models and Conformal Inference and a Comparison with Risk-Aware Verification
ACM Transactions on Cyber-Physical Systems · 30.04.2024 · 8 (2) · 1-25
DOI: 10.1145/3635160 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Cyber-Physical Systems, online erschienen am 14.05.2024. Verfasst von Xin Qin und 4 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 57 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: The National Science Foundation, Airbus Institute for Engineering Research, and funding by Toyota R&D and Siemens Corporate Research through the USC Center for Autonomy and AI.
Abstract (Originalsprache)
Uncertainty in safety-critical cyber-physical systems can be modeled using a finite number of parameters or parameterized input signals. Given a system specification in Signal Temporal Logic (STL), we would like to verify that for all (infinite) values of the model parameters/input signals, the system satisfies its specification. Unfortunately, this problem is undecidable in general. Statistical model checking (SMC) offers a solution by providing guarantees on the correctness of CPS models by statistically reasoning on model simulations. We propose a new approach for statistical verification of CPS models for user-provided distribution on the model parameters. Our technique uses model simulations to learn surrogate models , and uses conformal inference to provide probabilistic guarantees on the satisfaction of a given STL property. Additionally, we can provide prediction intervals containing the quantitative satisfaction values of the given STL property for any user-specified confidence level. We compare this prediction interval with the interval we get using risk estimation procedures. We also propose a refinement procedure based on Gaussian Process (GP)-based surrogate models for obtaining fine-grained probabilistic guarantees over sub-regions in the parameter space. This in turn enables the CPS designer to choose assured validity domains in the parameter space for safety-critical applications. Finally, we demonstrate the efficacy of our technique on several CPS models.
Förderung
- The National Science Foundation
- Airbus Institute for Engineering Research, and funding by Toyota R&D and Siemens Corporate Research through the USC Center for Autonomy and AI
Zitieren
APA
Qin, X., Xia, Y., Zutshi, A., Fan, C., & Deshmukh, J. V. (2024). Statistical Verification using Surrogate Models and Conformal Inference and a Comparison with Risk-Aware Verification. ACM Transactions on Cyber-Physical Systems, 8(2), 1-25. https://doi.org/10.1145/3635160
Vancouver
Qin X, Xia Y, Zutshi A, Fan C, Deshmukh JV. Statistical Verification using Surrogate Models and Conformal Inference and a Comparison with Risk-Aware Verification. ACM Transactions on Cyber-Physical Systems. 2024;8(2):1-25. doi:10.1145/3635160
BibTeX
@article{Qin2024,
author = {Qin, Xin and Xia, Yuan and Zutshi, Aditya and Fan, Chuchu and Deshmukh, Jyotirmoy V.},
title = {Statistical Verification using Surrogate Models and Conformal Inference and a Comparison with Risk-Aware Verification},
journal = {ACM Transactions on Cyber-Physical Systems},
year = {2024},
volume = {8},
number = {2},
pages = {1--25},
doi = {10.1145/3635160}
}
EUVIMED