EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

Deep Reinforcement Learning Verification: A Survey

Matthew Landers, Afsaneh Doryab

ACM Computing Surveys · 2023-12-31 · 55 (14s) · 1-31

DOI: 10.1145/3596444 ↗

At a glance

Journal article in ACM Computing Surveys, published online on 2023-07-17. Written by Matthew Landers and 1 co-authors. Cited 53 times so far (Crossref); 110 references. The full text is freely available (open access, CC BY 4.0).

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Deep reinforcement learning (DRL) has proven capable of superhuman performance on many complex tasks. To achieve this success, DRL algorithms train a decision-making agent to select the actions that maximize some long-term performance measure. In many consequential real-world domains, however, optimal performance is not enough to justify an algorithm’s use—for example, sometimes a system’s robustness, stability, or safety must be rigorously ensured. Thus, methods for verifying DRL systems have emerged. These algorithms can guarantee a system’s properties over an infinite set of inputs, but the task is not trivial. DRL relies on deep neural networks (DNNs). DNNs are often referred to as “black boxes” because examining their respective structures does not elucidate their decision-making processes. Moreover, the sequential nature of the problems DRL is used to solve promotes significant scalability challenges. Finally, because DRL environments are often stochastic, verification methods must account for probabilistic behavior. To address these complications, a new subfield has emerged. In this survey, we establish the foundations of DRL and DRL verification, define a taxonomy for DRL verification methods, describe approaches for dealing with stochasticity, characterize considerations related to writing specifications, enumerate common testing tasks/environments, and detail opportunities for future research.

Cite

APA

Landers, M., & Doryab, A. (2023). Deep Reinforcement Learning Verification: A Survey. ACM Computing Surveys, 55(14s), 1-31. https://doi.org/10.1145/3596444

Vancouver

Landers M, Doryab A. Deep Reinforcement Learning Verification: A Survey. ACM Computing Surveys. 2023;55(14s):1-31. doi:10.1145/3596444

BibTeX
@article{Landers2023,
  author = {Landers, Matthew and Doryab, Afsaneh},
  title = {Deep Reinforcement Learning Verification: A Survey},
  journal = {ACM Computing Surveys},
  year = {2023},
  volume = {55},
  number = {14s},
  pages = {1--31},
  doi = {10.1145/3596444}
}
Start for free →