Explore-Then-Commit with Dynamic Expertise Amplification
Proceedings of the AAAI Symposium Series · 18.05.2026 · 8 (1) · 627-635
DOI: 10.1609/aaaiss.v8i1.42598 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Symposium Series, online erschienen am 18.05.2026. Verfasst von Sree Bhargavi Balija und 1 weiteren Autor:innen.
Abstract (Originalsprache)
In resource-constrained real-world deployments, greedy exploration strategies that perpetually expand their budgets in pursuit of maximal reward become fundamentally impractical, demanding a principled framework that achieves high performance while strictly honoring computational and financial limits. Optimal allocation of limited resources between exploring new directions and exploiting proven strategies is a defining challenge in scientific research, education, and AI for Social Good. We introduce IDEA (Intelligent Dynamic Expertise Amplification via Explore-Then-Commit), a principled framework that recasts research strategy optimization as an expertise-aware contextual bandit problem. Theoretically, we prove that IDEA achieves expected regret E[R(T)] = O( √ KT log T) − Ω(ρ(T−τ )∥E∞∥), where the subtractive expertise term drives effective regret strictly negative for large T, a fundamental guarantee absent from state-of-the-art neural bandit methods, whose regret bounds are purely additive upper bounds of Oe( √ deT) with no compounding benefit. Computationally, IDEA requires only O(T(d 2+Kd)) operations, achieving a provable Θ(m2L/(Kd)) reduction in both time and memory over leading neural contextual bandit baselines. Empirically, in 1,300 controlled research trajectory simulations, IDEA delivers a cumulative reward of 15.5% higher than all state of-the-art bandit methods with strong statistical significance (p
Zitieren
APA
Balija, S. B., & Sahoo, D. (2026). Explore-Then-Commit with Dynamic Expertise Amplification. Proceedings of the AAAI Symposium Series, 8(1), 627-635. https://doi.org/10.1609/aaaiss.v8i1.42598
Vancouver
Balija SB, Sahoo D. Explore-Then-Commit with Dynamic Expertise Amplification. Proceedings of the AAAI Symposium Series. 2026;8(1):627-635. doi:10.1609/aaaiss.v8i1.42598
BibTeX
@article{Balija2026,
author = {Balija, Sree Bhargavi and Sahoo, Debashis},
title = {Explore-Then-Commit with Dynamic Expertise Amplification},
journal = {Proceedings of the AAAI Symposium Series},
year = {2026},
volume = {8},
number = {1},
pages = {627--635},
doi = {10.1609/aaaiss.v8i1.42598}
}
EUVIMED