EUVIMEDObjevte EUVIMED
Open access · CC BY 4.0

Belief-Aware Agentic Reinforcement Learning for Web Decision Models under Multi-Cost and Failure Risk Constraints

Arjun K. Singh, Priya Menon, Karthik Raman

Frontiers in Business and Finance · 2026-03-25 · 3 (1) · 191-200

DOI: 10.71465/fbf755 ↗

At a glance

Journal article in Frontiers in Business and Finance, published online on 2026-03-25. Written by Arjun K. Singh and 2 co-authors. The full text is freely available (open access, CC BY 4.0).

AbstraktBibliografické údajeCiteRelated studies

Abstract (original language)

Web interaction is inherently partially observable, as critical task-relevant information is distributed across multiple pages, dynamic UI elements, and delayed system feedback. This study formulates web agent decision-making as a belief-space constrained MDP, where the agent maintains a probabilistic belief over hidden task states and latent failure conditions. A belief-aware agentic reinforcement learning model is proposed that jointly updates task belief and failure-risk belief while optimizing task success under multiple cumulative cost budgets, including interaction steps, latency, and external tool usage. Failure risk is modeled as a belief-dependent hazard that evolves with both observed UI transitions and unobserved system states. The policy is trained using belief-conditioned value estimation and cost-regularized returns. Experiments are designed on a benchmark of approximately 1,200 web tasks across 50 website templates with partial observability induced by delayed confirmations and hidden irreversible actions. Results are evaluated in terms of success rate, belief calibration error, average cost per success, and failure incidence under fixed budgets. The proposed framestudy demonstrates improved robustness in long-horizon tasks where incorrect belief updates frequently lead to catastrophic decisions.

Cite

APA

Singh, A. K., Menon, P., & Raman, K. (2026). Belief-Aware Agentic Reinforcement Learning for Web Decision Models under Multi-Cost and Failure Risk Constraints. Frontiers in Business and Finance, 3(1), 191-200. https://doi.org/10.71465/fbf755

Vancouver

Singh AK, Menon P, Raman K. Belief-Aware Agentic Reinforcement Learning for Web Decision Models under Multi-Cost and Failure Risk Constraints. Frontiers in Business and Finance. 2026;3(1):191-200. doi:10.71465/fbf755

BibTeX
@article{Singh2026,
  author = {Singh, Arjun K. and Menon, Priya and Raman, Karthik},
  title = {Belief-Aware Agentic Reinforcement Learning for Web Decision Models under Multi-Cost and Failure Risk Constraints},
  journal = {Frontiers in Business and Finance},
  year = {2026},
  volume = {3},
  number = {1},
  pages = {191--200},
  doi = {10.71465/fbf755}
}
Start for free →