Testing SOAR tools in use
Computers & Security · 2023-06 · 129 · 103201
DOI: 10.1016/j.cose.2023.103201 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computers & Security, 2023-06. Verfasst von Robert A. Bridges und 13 weiteren Autor:innen. Die Arbeit wurde bisher 43-mal zitiert (Crossref) und nennt 55 Literaturangaben. Gefördert von: Government of South Australia, U.S. Department of Energy, Naval Information Warfare Systems Command.
Abstract (Originalsprache)
Modern security operation centers (SOCs) rely on operators and a tapestry of logging and alerting tools with large scale collection and query abilities. SOC investigations are tedious as they rely on manual efforts to query diverse data sources, overlay related logs, and correlate the data into information and then document results in a ticketing system. Security orchestration, automation, and response (SOAR) tools are a new technology that promise to collect, filter, and display needed data; automate common tasks that require SOC analysts' time; facilitate SOC collaboration; and, improve both efficiency and consistency of SOCs. SOAR tools have never been tested in practice to evaluate their effect and understand them in use. In this paper, we design and administer the first hands-on user study of SOAR tools, involving 24 participants and 6 commercial SOAR tools. Our contributions include the experimental design, itemizing six characteristics of SOAR tools and a methodology for testing them. We describe configuration of the test environment in a cyber range, including network, user, and threat emulation; a full SOC tool suite; and creation of artifacts allowing multiple representative investigation scenarios to permit testing. We present the first research results on SOAR tools. We found that SOAR configuration is critical, as it involves creative design for data display and automation. We found that SOAR tools increased efficiency and reduced context switching during investigations, although ticket accuracy and completeness (indicating investigation quality) decreased with SOAR use. Our findings indicated that user preferences are slightly negatively correlated with their performance with the tool; overautomation was a concern of senior analysts, and SOAR tools that balanced automation with assisting a user to make decisions were preferred.
Förderung
- Government of South Australia
- U.S. Department of Energy
- Naval Information Warfare Systems Command
- Oak Ridge National Laboratory
- UT-Battelle
- U.S. Department of Defense
- North Carolina State University
Zitieren
APA
Bridges, R. A., Rice, A. E., Oesch, S., Nichols, J. A., Watson, C., Spakes, K., Norem, S., Huettel, M., Jewell, B., Weber, B., Gannon, C., Bizovi, O., Hollifield, S. C., & Erwin, S. (2023). Testing SOAR tools in use. Computers & Security, 129, 103201. https://doi.org/10.1016/j.cose.2023.103201
Vancouver
Bridges RA, Rice AE, Oesch S, Nichols JA, Watson C, Spakes K, et al. Testing SOAR tools in use. Computers & Security. 2023;129:103201. doi:10.1016/j.cose.2023.103201
BibTeX
@article{Bridges2023,
author = {Bridges, Robert A. and Rice, Ashley E. and Oesch, Sean and Nichols, Jeffrey. A. and Watson, Cory and Spakes, Kevin and Norem, Savannah and Huettel, Mike and Jewell, Brian and Weber, Brian and Gannon, Connor and Bizovi, Olivia and Hollifield, Samuel C. and Erwin, Samantha},
title = {Testing SOAR tools in use},
journal = {Computers & Security},
year = {2023},
volume = {129},
pages = {103201},
doi = {10.1016/j.cose.2023.103201}
}
EUVIMED