EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Executable Verification Framework for Benchmarking AI-Based Decision Support in Physically Network-Constrained Energy Systems

Shafaa Mahmood Shnawa

Recent Innovations in Mechatronics · 18.11.2026 · 1-9

DOI: 10.17667/riim.2026.1 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Recent Innovations in Mechatronics, online erschienen am 18.11.2026. Verfasst von Shafaa Mahmood Shnawa. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Benchmarks of inverter-based power grids that use machine learning (ML), large language models (LLMs), and learning-based inverter control can be misleading when fluent responses are operationally infeasible, judge-based scores are biased, or forecast-accuracy metrics such as Mean Absolute Error (MAE) do not reflect reserve and dispatch consequences. This study introduces VERITAS-GridBench, an operationally grounded benchmark in which decision-support outputs are evaluated against simulator/optimizer-based "Executable Truth" using explicit feasibility and constraint-violation measures. The framework combines tool verification, rule-based checks, and calibrated multi-judge semantic assessment through Triangulated Scoring, while also incorporating reproducibility, contamination control, domain-shift testing, and a Forecast-to-Operations (F2O) pathway. The experiments compare judge-only, multi-judge, and triangulated evaluation for power-system decision support and compare representative statistical, machine-learning, sequence, convolutional, and transformer forecasting models after their forecasts are propagated to reserve and dispatch calculations. The results show that judge-only scoring can reward fluent but infeasible actions, whereas tool-verified triangulation markedly increases feasibility and reduces unsafe wins and constraint violations. The forecasting results further show that lower MAE does not necessarily imply lower operational cost or risk. These findings support end-to-end evaluation in which model quality is judged by both predictive performance and physically executable grid outcomes.

Zitieren

APA

Shnawa, S. M. (2026). Executable Verification Framework for Benchmarking AI-Based Decision Support in Physically Network-Constrained Energy Systems. Recent Innovations in Mechatronics, 1-9. https://doi.org/10.17667/riim.2026.1

Vancouver

Shnawa SM. Executable Verification Framework for Benchmarking AI-Based Decision Support in Physically Network-Constrained Energy Systems. Recent Innovations in Mechatronics. 2026:1-9. doi:10.17667/riim.2026.1

BibTeX
@article{Shnawa2026,
  author = {Shnawa, Shafaa Mahmood},
  title = {Executable Verification Framework for Benchmarking AI-Based Decision Support in Physically Network-Constrained Energy Systems},
  journal = {Recent Innovations in Mechatronics},
  year = {2026},
  pages = {1--9},
  doi = {10.17667/riim.2026.1}
}
Kostenlos starten →