EUVIMEDEUVIMED entdecken
Crossref

Rating Composite AI Models for Robustness Through Probabilistic Planning

Kausik Lakkaraju, Sunandita Patra, Parisa Zehtabi, Biplav Srivastava

Proceedings of the International Conference on Automated Planning and Scheduling · 08.06.2026 · 36 (1) · 500-508

DOI: 10.1609/icaps.v36i1.42867 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the International Conference on Automated Planning and Scheduling, online erschienen am 08.06.2026. Verfasst von Kausik Lakkaraju und 3 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Many real-world AI systems combine several primitive component models, such as translators and sentiment analyzers, into larger composite models, like chatbots. Understanding how these compositions behave under uncertainty and how properties like bias or instability move through a composite model is increasingly important, yet most evaluation methods still focus on primitive models. We introduce a new use of probabilistic planning to assess the robustness of composite AI models. Each component model call is represented as a stochastic action in the RDDL domain, and the reward combines robustness metrics to the cost of components (actions). The planner runs each primitive model on randomly drawn data batches, allowing robustness to be assessed under variation in both the data and the model outputs induced by those data. We demonstrate via case studies and experiments in multilingual sentiment analysis and a synthetic domain, the planner consistently identifies more stable composite configurations than baseline methods, showing that probabilistic planning can serve as a practical, scalable approach for reasoning about reliability in complex, composite AI models.

Zitieren

APA

Lakkaraju, K., Patra, S., Zehtabi, P., & Srivastava, B. (2026). Rating Composite AI Models for Robustness Through Probabilistic Planning. Proceedings of the International Conference on Automated Planning and Scheduling, 36(1), 500-508. https://doi.org/10.1609/icaps.v36i1.42867

Vancouver

Lakkaraju K, Patra S, Zehtabi P, Srivastava B. Rating Composite AI Models for Robustness Through Probabilistic Planning. Proceedings of the International Conference on Automated Planning and Scheduling. 2026;36(1):500-508. doi:10.1609/icaps.v36i1.42867

BibTeX
@article{Lakkaraju2026,
  author = {Lakkaraju, Kausik and Patra, Sunandita and Zehtabi, Parisa and Srivastava, Biplav},
  title = {Rating Composite AI Models for Robustness Through Probabilistic Planning},
  journal = {Proceedings of the International Conference on Automated Planning and Scheduling},
  year = {2026},
  volume = {36},
  number = {1},
  pages = {500--508},
  doi = {10.1609/icaps.v36i1.42867}
}
Kostenlos starten →