EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Quantum Bayesian networks can speed up reinforcement learning in partially observable environments

Gilberto Cunha, Alexandra Ramôa, André Sequeira, Michael de Oliveira, Luís Barbosa

Quantum Machine Intelligence · 2026-12 · 8 (2)

DOI: 10.1007/s42484-026-00401-9 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Quantum Machine Intelligence, online erschienen am 11.06.2026. Verfasst von Gilberto Cunha und 4 weiteren Autor:innen. Die Arbeit nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: INL - International Iberian Nanotechnology Laboratory.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Reinforcement learning (RL) provides a principled framework for decision-making in partially observable environments, which can be modeled as Markov decision processes and compactly represented through dynamic decision Bayesian networks. Recent advances demonstrate that inference on sparse Bayesian networks can be accelerated using quantum rejection sampling combined with amplitude amplification, leading to a computational speedup in estimating acceptance probabilities. Building on this result, we introduce Quantum Bayesian Reinforcement Learning (QBRL), a hybrid quantum-classical look-ahead algorithm for model-based RL in partially observable environments. We present a rigorous, oracle-free time complexity analysis under fault-tolerant assumptions for the quantum device. Unlike standard treatments that assume a black-box oracle, we explicitly specify the inference process, allowing our bounds to more accurately reflect the true computational cost. We show that, for environments whose dynamics form a sparse Bayesian network, horizon-based near-optimal planning can be achieved sub-quadratically faster through quantum-enhanced belief updates. On the other hand, we show that there is no quantum speed-up for environments that are either fully observable, or characterized by Bayesian networks whose maximum in-degree is not small. Furthermore, we present numerical experiments benchmarking QBRL against its classical counterpart on simple yet illustrative decision-making tasks. Our results offer a detailed analysis of how the quantum computational advantage translates into decision-making performance, highlighting that the magnitude of the advantage can vary significantly across different deployment settings.

Förderung

  • INL - International Iberian Nanotechnology Laboratory

Zitieren

APA

Cunha, G., Ramôa, A., Sequeira, A., Oliveira, M. D., & Barbosa, L. (2026). Quantum Bayesian networks can speed up reinforcement learning in partially observable environments. Quantum Machine Intelligence, 8(2). https://doi.org/10.1007/s42484-026-00401-9

Vancouver

Cunha G, Ramôa A, Sequeira A, Oliveira MD, Barbosa L. Quantum Bayesian networks can speed up reinforcement learning in partially observable environments. Quantum Machine Intelligence. 2026;8(2). doi:10.1007/s42484-026-00401-9

BibTeX
@article{Cunha2026,
  author = {Cunha, Gilberto and Ramôa, Alexandra and Sequeira, André and Oliveira, Michael de and Barbosa, Luís},
  title = {Quantum Bayesian networks can speed up reinforcement learning in partially observable environments},
  journal = {Quantum Machine Intelligence},
  year = {2026},
  volume = {8},
  number = {2},
  doi = {10.1007/s42484-026-00401-9}
}
Kostenlos starten →