Form over Substance: A Metric-Decomposition Diagnosis of Group Relative Policy Optimization for Arabic Legal Reasoning
Islamic University Journal of Applied Sciences · 01.12.2026 · VIII (2) · 346-366
DOI: 10.63070/jesc.2026.046 ↗Kurz gefasst
Fachartikel in der Zeitschrift Islamic University Journal of Applied Sciences, online erschienen am 01.12.2026. Verfasst von Nawaf Al Enezi und 2 weiteren Autor:innen.
Abstract (Originalsprache)
Reinforcement learning with verifiable rewards (RLVR) drives much post-training of reasoning models, yet it is judged by a rising reward curve that cannot indicate which of several rule-based verifiers earned the gain. This study makes that observable during training through the weight-zero monitor: the substantive verifier is registered a second time at weight 0.0 and logged alongside the within-group standard deviation of each component, so that it cannot be optimized against. It was applied within an internally registered falsification program of Group Relative Policy Optimization (GRPO) on Qwen3-8B over Saudi commercial rulings. The registered attempt moved the policy without improving it: every greedy completion changed, 54% of held-out dispositions changed, macro-F1 fell by 0.067 (95% CI [−0.136, +0.011]), and repetition halved while the monitor remained flat. Acting on this reading, eight-sample majority voting, which trains nothing, achieved the only significant gain, +0.088 macro-F1 on a frozen 300-case instrument (95% CI [0.043, 0.140]). We derive when a gated composite reward rewards form rather than substance, and we recommend measuring the extractable headroom before allocating compute to policy-gradient training.
Zitieren
APA
Enezi, N. A., Alshanqiti, A., & Alkhodre, A. B. (2026). Form over Substance: A Metric-Decomposition Diagnosis of Group Relative Policy Optimization for Arabic Legal Reasoning. Islamic University Journal of Applied Sciences, VIII(2), 346-366. https://doi.org/10.63070/jesc.2026.046
Vancouver
Enezi NA, Alshanqiti A, Alkhodre AB. Form over Substance: A Metric-Decomposition Diagnosis of Group Relative Policy Optimization for Arabic Legal Reasoning. Islamic University Journal of Applied Sciences. 2026;VIII(2):346-366. doi:10.63070/jesc.2026.046
BibTeX
@article{Enezi2026,
author = {Enezi, Nawaf Al and Alshanqiti, Abdullah and Alkhodre, Ahmad B},
title = {Form over Substance: A Metric-Decomposition Diagnosis of Group Relative Policy Optimization for Arabic Legal Reasoning},
journal = {Islamic University Journal of Applied Sciences},
year = {2026},
volume = {VIII},
number = {2},
pages = {346--366},
doi = {10.63070/jesc.2026.046}
}
EUVIMED