A Delphi–Monte Carlo Framework for Probabilistic KPI Estimation in Public-Sector AI Projects
Systems · 17.08.2026 · 14 (8) · 1003
DOI: 10.3390/systems14081003 ↗Kurz gefasst
Delphi-Studie in der Zeitschrift Systems, online erschienen am 17.08.2026. Verfasst von Rymkul Ismailova und 4 weiteren Autor:innen. Die Arbeit nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Science Committee of the Ministry of Science and Higher Education of the Republic of Kazakhstan.
Abstract (Originalsprache)
Public-sector organisations must often commit to AI adoption decisions before longitudinal performance data are available to inform them. This study introduces and preliminarily demonstrates a Delphi–PERT–Monte Carlo framework for probabilistic KPI estimation in public-sector AI projects, applied to Kazakhstan’s e-government environment. A three-round modified Delphi study was conducted with 20 domain experts (competence threshold K ≥ 0.70). The Technology–Organisation–Environment framework structured elicitation across three AI scenarios (S0: no AI; S1: partial automation; S2: advanced AI) and four KPIs: timeline, cost, risk detection, and process transparency. Categorical percentage-band responses were translated into PERT distributions via a documented band-to-midpoint mapping rule and simulated through 10,000 Monte Carlo iterations. All outputs reflect structured expert belief, not observed performance data. Under S2, timeline effects were directionally ambiguous (P50 = −0.5%; bootstrap 95% CI: [−5.0%, +13.5%]); cost was consistently positive (P50 = +13.7%), reflecting near-term implementation cost increases expected by 55% of panelists. Risk detection (P50 = +5.8%; CI: [+3.7%, +12.8%]) and transparency (P50 = +8.2%; CI: [+2.5%, +8.8%]) showed modest but stable positive effects. Round 3 returned 80% consensus acceptance. The framework provides a replicable, sensitivity-tested procedure for generating probabilistic planning inputs in expert-data-scarce contexts; the Kazakhstan case is its first Central Asian application.
Förderung
- Science Committee of the Ministry of Science and Higher Education of the Republic of Kazakhstan
Zitieren
APA
Ismailova, R., Ibadildin, N., Kadyrova, A., Yesmagulova, N., & Issabayeva, S. (2026). A Delphi–Monte Carlo Framework for Probabilistic KPI Estimation in Public-Sector AI Projects. Systems, 14(8), 1003. https://doi.org/10.3390/systems14081003
Vancouver
Ismailova R, Ibadildin N, Kadyrova A, Yesmagulova N, Issabayeva S. A Delphi–Monte Carlo Framework for Probabilistic KPI Estimation in Public-Sector AI Projects. Systems. 2026;14(8):1003. doi:10.3390/systems14081003
BibTeX
@article{Ismailova2026,
author = {Ismailova, Rymkul and Ibadildin, Nurkhat and Kadyrova, Aiman and Yesmagulova, Nurgul and Issabayeva, Symbat},
title = {A Delphi–Monte Carlo Framework for Probabilistic KPI Estimation in Public-Sector AI Projects},
journal = {Systems},
year = {2026},
volume = {14},
number = {8},
pages = {1003},
doi = {10.3390/systems14081003}
}
EUVIMED