Evaluation of Neural Network Verification Methods for Air-to-Air Collision Avoidance
Journal of Air Transportation · 2023-01 · 31 (1) · 1-17
DOI: 10.2514/1.d0255 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Air Transportation, 2023-01. Verfasst von Diego Manzanas Lopez und 4 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 24 Literaturangaben. Gefördert von: ONR, Defense Advanced Research Projects Agency, Air Force Office of Scientific Research.
Abstract (Originalsprache)
Neural network approximations have become attractive to compress data for automation and autonomy algorithms for use on storage-limited and processing-limited aerospace hardware. However, unless these neural network approximations can be exhaustively verified to be safe, they cannot be certified for use on aircraft. An example of such systems is the unmanned Airborne Collision Avoidance System (ACAS) Xu, which is a very popular benchmark for open-loop neural network control system verification tools. This paper proposes a new closed-loop extension of this benchmark, which consists of a set of 10 closed-loop properties selected to evaluate the safety of an ownship aircraft in the presence of a co-altitude intruder aircraft. These closed-loop safety properties are used to evaluate five of the 45 neural networks that comprise the ACAS Xu benchmark (corresponding to co-altitude cases) as well as the switching logic between the five neural networks. The combination of nonlinear dynamics and switching between five neural networks is a challenging verification task accomplished with star-set reachability methods in two verification tools. The safety of the ownship aircraft under initial position uncertainty is guaranteed in every scenario proposed.
Förderung
- ONR
- Defense Advanced Research Projects Agency
- Air Force Office of Scientific Research
- Division of Computing and Communication Foundations
Zitieren
APA
Lopez, D. M., Johnson, T. T., Bak, S., Tran, H., & Hobbs, K. L. (2023). Evaluation of Neural Network Verification Methods for Air-to-Air Collision Avoidance. Journal of Air Transportation, 31(1), 1-17. https://doi.org/10.2514/1.d0255
Vancouver
Lopez DM, Johnson TT, Bak S, Tran H, Hobbs KL. Evaluation of Neural Network Verification Methods for Air-to-Air Collision Avoidance. Journal of Air Transportation. 2023;31(1):1-17. doi:10.2514/1.d0255
BibTeX
@article{Lopez2023,
author = {Lopez, Diego Manzanas and Johnson, Taylor T. and Bak, Stanley and Tran, Hoang-Dung and Hobbs, Kerianne L.},
title = {Evaluation of Neural Network Verification Methods for Air-to-Air Collision Avoidance},
journal = {Journal of Air Transportation},
year = {2023},
volume = {31},
number = {1},
pages = {1--17},
doi = {10.2514/1.d0255}
}
EUVIMED