EUVIMEDEUVIMED entdecken
Crossref

Form over Substance: A Metric-Decomposition Diagnosis of Group Relative Policy Optimization for Arabic Legal Reasoning

Nawaf Al Enezi, Abdullah Alshanqiti, Ahmad B Alkhodre

Islamic University Journal of Applied Sciences · 01.12.2026 · VIII (2) · 346-366

DOI: 10.63070/jesc.2026.046 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Islamic University Journal of Applied Sciences, online erschienen am 01.12.2026. Verfasst von Nawaf Al Enezi und 2 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Reinforcement learning with verifiable rewards (RLVR) drives much post-training of reasoning models, yet it is judged by a rising reward curve that cannot indicate which of several rule-based verifiers earned the gain. This study makes that observable during training through the weight-zero monitor: the substantive verifier is registered a second time at weight 0.0 and logged alongside the within-group standard deviation of each component, so that it cannot be optimized against. It was applied within an internally registered falsification program of Group Relative Policy Optimization (GRPO) on Qwen3-8B over Saudi commercial rulings. The registered attempt moved the policy without improving it: every greedy completion changed, 54% of held-out dispositions changed, macro-F1 fell by 0.067 (95% CI [−0.136, +0.011]), and repetition halved while the monitor remained flat. Acting on this reading, eight-sample majority voting, which trains nothing, achieved the only significant gain, +0.088 macro-F1 on a frozen 300-case instrument (95% CI [0.043, 0.140]). We derive when a gated composite reward rewards form rather than substance, and we recommend measuring the extractable headroom before allocating compute to policy-gradient training.

Zitieren

APA

Enezi, N. A., Alshanqiti, A., & Alkhodre, A. B. (2026). Form over Substance: A Metric-Decomposition Diagnosis of Group Relative Policy Optimization for Arabic Legal Reasoning. Islamic University Journal of Applied Sciences, VIII(2), 346-366. https://doi.org/10.63070/jesc.2026.046

Vancouver

Enezi NA, Alshanqiti A, Alkhodre AB. Form over Substance: A Metric-Decomposition Diagnosis of Group Relative Policy Optimization for Arabic Legal Reasoning. Islamic University Journal of Applied Sciences. 2026;VIII(2):346-366. doi:10.63070/jesc.2026.046

BibTeX
@article{Enezi2026,
  author = {Enezi, Nawaf Al and Alshanqiti, Abdullah and Alkhodre, Ahmad B},
  title = {Form over Substance: A Metric-Decomposition Diagnosis of Group Relative Policy Optimization for Arabic Legal Reasoning},
  journal = {Islamic University Journal of Applied Sciences},
  year = {2026},
  volume = {VIII},
  number = {2},
  pages = {346--366},
  doi = {10.63070/jesc.2026.046}
}
Kostenlos starten →