EUVIMEDOpdag EUVIMED
Crossref

Building Guardrails in AI Systems with Threat Modeling

Jayati Dev, Nuray Baltaci Akhuseyinoglu, Golam Kayas, Bahman Rashidi, Vaibhav Garg

Digital Government: Research and Practice · 2025-03-31 · 6 (1) · 1-18

DOI: 10.1145/3674845 ↗

At a glance

Journal article in Digital Government: Research and Practice, published online on 2025-02-13. Written by Jayati Dev and 4 co-authors. Cited 11 times so far (Crossref); 37 references.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Much like cars, AI technologies must undergo rigorous testing to ensure their safety and reliability. However, just as a 16-wheel truck’s brakes are different from that of a standard hatchback, AI models too may need distinct analyses based on their risk, size, application domain, and other factors. Prior research has attempted to do this, by identifying areas of concern for AI/ML applications and tools needed to simulate the effect of adversarial actors. However, currently, a variety of frameworks exist which poses challenges due to inconsistent terminology, focus, complexity, and interoperability issues, hindering effective threat discovery. In this article, we present a meta-analysis of 14 AI threat modeling frameworks, providing a streamlined set of questions for AI/ML threat analysis. We then review this library, incorporating feedback from 10 experts to refine the questions. This refined set of questions allow practitioners to seamlessly integrate threat analysis for comprehensive manual evaluation of a wide range of AI/ML applications.

Cite

APA

Dev, J., Akhuseyinoglu, N. B., Kayas, G., Rashidi, B., & Garg, V. (2025). Building Guardrails in AI Systems with Threat Modeling. Digital Government: Research and Practice, 6(1), 1-18. https://doi.org/10.1145/3674845

Vancouver

Dev J, Akhuseyinoglu NB, Kayas G, Rashidi B, Garg V. Building Guardrails in AI Systems with Threat Modeling. Digital Government: Research and Practice. 2025;6(1):1-18. doi:10.1145/3674845

BibTeX
@article{Dev2025,
  author = {Dev, Jayati and Akhuseyinoglu, Nuray Baltaci and Kayas, Golam and Rashidi, Bahman and Garg, Vaibhav},
  title = {Building Guardrails in AI Systems with Threat Modeling},
  journal = {Digital Government: Research and Practice},
  year = {2025},
  volume = {6},
  number = {1},
  pages = {1--18},
  doi = {10.1145/3674845}
}
Start for free →