Executable Verification Framework for Benchmarking AI-Based Decision Support in Physically Network-Constrained Energy Systems
Recent Innovations in Mechatronics · 18.11.2026 · 1-9
DOI: 10.17667/riim.2026.1 ↗Kurz gefasst
Fachartikel in der Zeitschrift Recent Innovations in Mechatronics, online erschienen am 18.11.2026. Verfasst von Shafaa Mahmood Shnawa. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Benchmarks of inverter-based power grids that use machine learning (ML), large language models (LLMs), and learning-based inverter control can be misleading when fluent responses are operationally infeasible, judge-based scores are biased, or forecast-accuracy metrics such as Mean Absolute Error (MAE) do not reflect reserve and dispatch consequences. This study introduces VERITAS-GridBench, an operationally grounded benchmark in which decision-support outputs are evaluated against simulator/optimizer-based "Executable Truth" using explicit feasibility and constraint-violation measures. The framework combines tool verification, rule-based checks, and calibrated multi-judge semantic assessment through Triangulated Scoring, while also incorporating reproducibility, contamination control, domain-shift testing, and a Forecast-to-Operations (F2O) pathway. The experiments compare judge-only, multi-judge, and triangulated evaluation for power-system decision support and compare representative statistical, machine-learning, sequence, convolutional, and transformer forecasting models after their forecasts are propagated to reserve and dispatch calculations. The results show that judge-only scoring can reward fluent but infeasible actions, whereas tool-verified triangulation markedly increases feasibility and reduces unsafe wins and constraint violations. The forecasting results further show that lower MAE does not necessarily imply lower operational cost or risk. These findings support end-to-end evaluation in which model quality is judged by both predictive performance and physically executable grid outcomes.
Zitieren
APA
Shnawa, S. M. (2026). Executable Verification Framework for Benchmarking AI-Based Decision Support in Physically Network-Constrained Energy Systems. Recent Innovations in Mechatronics, 1-9. https://doi.org/10.17667/riim.2026.1
Vancouver
Shnawa SM. Executable Verification Framework for Benchmarking AI-Based Decision Support in Physically Network-Constrained Energy Systems. Recent Innovations in Mechatronics. 2026:1-9. doi:10.17667/riim.2026.1
BibTeX
@article{Shnawa2026,
author = {Shnawa, Shafaa Mahmood},
title = {Executable Verification Framework for Benchmarking AI-Based Decision Support in Physically Network-Constrained Energy Systems},
journal = {Recent Innovations in Mechatronics},
year = {2026},
pages = {1--9},
doi = {10.17667/riim.2026.1}
}
EUVIMED