Building Guardrails in AI Systems with Threat Modeling
Digital Government: Research and Practice · 31.03.2025 · 6 (1) · 1-18
DOI: 10.1145/3674845 ↗Kurz gefasst
Fachartikel in der Zeitschrift Digital Government: Research and Practice, online erschienen am 13.02.2025. Verfasst von Jayati Dev und 4 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 37 Literaturangaben.
Abstract (Originalsprache)
Much like cars, AI technologies must undergo rigorous testing to ensure their safety and reliability. However, just as a 16-wheel truck’s brakes are different from that of a standard hatchback, AI models too may need distinct analyses based on their risk, size, application domain, and other factors. Prior research has attempted to do this, by identifying areas of concern for AI/ML applications and tools needed to simulate the effect of adversarial actors. However, currently, a variety of frameworks exist which poses challenges due to inconsistent terminology, focus, complexity, and interoperability issues, hindering effective threat discovery. In this article, we present a meta-analysis of 14 AI threat modeling frameworks, providing a streamlined set of questions for AI/ML threat analysis. We then review this library, incorporating feedback from 10 experts to refine the questions. This refined set of questions allow practitioners to seamlessly integrate threat analysis for comprehensive manual evaluation of a wide range of AI/ML applications.
Zitieren
APA
Dev, J., Akhuseyinoglu, N. B., Kayas, G., Rashidi, B., & Garg, V. (2025). Building Guardrails in AI Systems with Threat Modeling. Digital Government: Research and Practice, 6(1), 1-18. https://doi.org/10.1145/3674845
Vancouver
Dev J, Akhuseyinoglu NB, Kayas G, Rashidi B, Garg V. Building Guardrails in AI Systems with Threat Modeling. Digital Government: Research and Practice. 2025;6(1):1-18. doi:10.1145/3674845
BibTeX
@article{Dev2025,
author = {Dev, Jayati and Akhuseyinoglu, Nuray Baltaci and Kayas, Golam and Rashidi, Bahman and Garg, Vaibhav},
title = {Building Guardrails in AI Systems with Threat Modeling},
journal = {Digital Government: Research and Practice},
year = {2025},
volume = {6},
number = {1},
pages = {1--18},
doi = {10.1145/3674845}
}
EUVIMED