EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Addressing uncertainty in the safety assurance of machine-learning

Simon Burton, Benjamin Herd

Frontiers in Computer Science · 06.04.2023 · 5

DOI: 10.3389/fcomp.2023.1132580 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Computer Science, online erschienen am 06.04.2023. Verfasst von Simon Burton und 1 weiteren Autor:innen. Die Arbeit wurde bisher 56-mal zitiert (Crossref) und nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Fraunhofer-Gesellschaft.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

There is increasing interest in the application of machine learning (ML) technologies to safety-critical cyber-physical systems, with the promise of increased levels of autonomy due to their potential for solving complex perception and planning tasks. However, demonstrating the safety of ML is seen as one of the most challenging hurdles to their widespread deployment for such applications. In this paper we explore the factors which make the safety assurance of ML such a challenging task. In particular we address the impact of uncertainty on the confidence in ML safety assurance arguments. We show how this uncertainty is related to complexity in the ML models as well as the inherent complexity of the tasks that they are designed to implement. Based on definitions of uncertainty as well as an exemplary assurance argument structure, we examine typical weaknesses in the argument and how these can be addressed. The analysis combines an understanding of causes of insufficiencies in ML models with a systematic analysis of the types of asserted context, asserted evidence and asserted inference within the assurance argument. This leads to a systematic identification of requirements on the assurance argument structure as well as supporting evidence. We conclude that a combination of qualitative arguments combined with quantitative evidence are required to build a robust argument for safety-related properties of ML functions that is continuously refined to reduce residual and emerging uncertainties in the arguments after the function has been deployed into the target environment.

Förderung

  • Fraunhofer-Gesellschaft

Zitieren

APA

Burton, S., & Herd, B. (2023). Addressing uncertainty in the safety assurance of machine-learning. Frontiers in Computer Science, 5. https://doi.org/10.3389/fcomp.2023.1132580

Vancouver

Burton S, Herd B. Addressing uncertainty in the safety assurance of machine-learning. Frontiers in Computer Science. 2023;5. doi:10.3389/fcomp.2023.1132580

BibTeX
@article{Burton2023,
  author = {Burton, Simon and Herd, Benjamin},
  title = {Addressing uncertainty in the safety assurance of machine-learning},
  journal = {Frontiers in Computer Science},
  year = {2023},
  volume = {5},
  doi = {10.3389/fcomp.2023.1132580}
}
Kostenlos starten →