Probe-Then-Commit: Constrained Reinforcement Learning for Adaptive Precision and Early-Exit Inference on Resource-Constrained Edge Devices
International Journal of Advanced Engineering and Technology Research · 30.10.2026 · 3 (3) · 58-65
DOI: 10.54097/jc1bep53 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Advanced Engineering and Technology Research, online erschienen am 30.10.2026. Verfasst von Zain Klein und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Transformer encoders deployed on edge devices must answer each query within a latency deadline while the energy budget, temperature, and memory bandwidth of the device change over time. Hand-designed runtime managers switch among pre-compiled precision modes with feedback rules, but they react to the device rather than to the input and do not plan how a session budget is spent. We cast adaptive inference as a constrained Markov decision process and propose a probe-then-commit controller trained with proximal policy optimization and PID-Lagrangian multipliers. For every query the policy first selects the precision of a three-layer probe, reads the normalized entropy of the probe’s exit classifier, and then either answers immediately or commits a suffix precision and an exit threshold. A feasibility shield masks actions that would violate the response deadline or an energy reserve, and a behavior-cloning warm start from a myopic pacing heuristic stabilizes learning. The controller is trained in a trace-driven environment built from real per-utterance outputs of a RoBERTa-base intent classifier on SLURP and from a batch-1 latency table measured on a CPU core (8.9% MAPE against end-to-end timing). The measurements show that natively supported INT8 and BF16 kernels run 7–15× faster than software-unpacked 4-bit weights and that the layer-9 exit is more accurate than the full network. Across five held-out device scenarios the controller attains 87.00% mean accuracy with no budget depletion, compared with 86.75% for a tuned greedy pacing controller, 86.46% for a tuned re-implementation of a PID runtime manager, and 85.35% for the best static rule.
Zitieren
APA
Klein, Z., & Price, V. (2026). Probe-Then-Commit: Constrained Reinforcement Learning for Adaptive Precision and Early-Exit Inference on Resource-Constrained Edge Devices. International Journal of Advanced Engineering and Technology Research, 3(3), 58-65. https://doi.org/10.54097/jc1bep53
Vancouver
Klein Z, Price V. Probe-Then-Commit: Constrained Reinforcement Learning for Adaptive Precision and Early-Exit Inference on Resource-Constrained Edge Devices. International Journal of Advanced Engineering and Technology Research. 2026;3(3):58-65. doi:10.54097/jc1bep53
BibTeX
@article{Klein2026,
author = {Klein, Zain and Price, Victor},
title = {Probe-Then-Commit: Constrained Reinforcement Learning for Adaptive Precision and Early-Exit Inference on Resource-Constrained Edge Devices},
journal = {International Journal of Advanced Engineering and Technology Research},
year = {2026},
volume = {3},
number = {3},
pages = {58--65},
doi = {10.54097/jc1bep53}
}
EUVIMED