EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Deep Reinforcement Learning Verification: A Survey

Matthew Landers, Afsaneh Doryab

ACM Computing Surveys · 31.12.2023 · 55 (14s) · 1-31

DOI: 10.1145/3596444 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 17.07.2023. Verfasst von Matthew Landers und 1 weiteren Autor:innen. Die Arbeit wurde bisher 53-mal zitiert (Crossref) und nennt 110 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deep reinforcement learning (DRL) has proven capable of superhuman performance on many complex tasks. To achieve this success, DRL algorithms train a decision-making agent to select the actions that maximize some long-term performance measure. In many consequential real-world domains, however, optimal performance is not enough to justify an algorithm’s use—for example, sometimes a system’s robustness, stability, or safety must be rigorously ensured. Thus, methods for verifying DRL systems have emerged. These algorithms can guarantee a system’s properties over an infinite set of inputs, but the task is not trivial. DRL relies on deep neural networks (DNNs). DNNs are often referred to as “black boxes” because examining their respective structures does not elucidate their decision-making processes. Moreover, the sequential nature of the problems DRL is used to solve promotes significant scalability challenges. Finally, because DRL environments are often stochastic, verification methods must account for probabilistic behavior. To address these complications, a new subfield has emerged. In this survey, we establish the foundations of DRL and DRL verification, define a taxonomy for DRL verification methods, describe approaches for dealing with stochasticity, characterize considerations related to writing specifications, enumerate common testing tasks/environments, and detail opportunities for future research.

Zitieren

APA

Landers, M., & Doryab, A. (2023). Deep Reinforcement Learning Verification: A Survey. ACM Computing Surveys, 55(14s), 1-31. https://doi.org/10.1145/3596444

Vancouver

Landers M, Doryab A. Deep Reinforcement Learning Verification: A Survey. ACM Computing Surveys. 2023;55(14s):1-31. doi:10.1145/3596444

BibTeX
@article{Landers2023,
  author = {Landers, Matthew and Doryab, Afsaneh},
  title = {Deep Reinforcement Learning Verification: A Survey},
  journal = {ACM Computing Surveys},
  year = {2023},
  volume = {55},
  number = {14s},
  pages = {1--31},
  doi = {10.1145/3596444}
}
Kostenlos starten →