Understanding Industry Perspectives of Static Application Security Testing (SAST) Evaluation
Proceedings of the ACM on Software Engineering · 19.06.2025 · 2 (FSE) · 3033-3056
DOI: 10.1145/3729404 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Software Engineering, online erschienen am 19.06.2025. Verfasst von Yuan Li und 8 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 91 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Leading Innovative and Entrepreneur Team Introduction Program of Hangzhou.
Abstract (Originalsprache)
The demand for automated security analysis techniques, specifically static application security testing (SAST), is steadily rising. Assessing the effectiveness of SAST tools is crucial for evaluating current techniques and inspiring future technical advancements. Regrettably, recent research suggests that existing benchmarks used for evaluation often fail to meet the industry’s needs, significantly impeding the adoption of SASTs in real-world scenarios. This paper presents a qualitative study to bridge this gap. We investigate why industrial professionals utilize SAST benchmarks, identify barriers to their usage, and explore potential improvements for existing benchmarks. Specifically, we conducted in-depth, semi-structured interviews with twenty industrial professionals possessing diverse field experience and backgrounds in security and product development. As the first comprehensive investigation of SAST evaluation from an industrial perspective, our findings would break down the barriers between academia and industry, providing valuable inspiration for designing better benchmarks and promoting new advances in SAST evaluation.
Förderung
- National Natural Science Foundation of China
- Leading Innovative and Entrepreneur Team Introduction Program of Hangzhou
Zitieren
APA
Li, Y., Yao, P., Yu, K., Wang, C., Ye, Y., Li, S., Luo, M., Liu, Y., & Ren, K. (2025). Understanding Industry Perspectives of Static Application Security Testing (SAST) Evaluation. Proceedings of the ACM on Software Engineering, 2(FSE), 3033-3056. https://doi.org/10.1145/3729404
Vancouver
Li Y, Yao P, Yu K, Wang C, Ye Y, Li S, et al. Understanding Industry Perspectives of Static Application Security Testing (SAST) Evaluation. Proceedings of the ACM on Software Engineering. 2025;2(FSE):3033-3056. doi:10.1145/3729404
BibTeX
@article{Li2025,
author = {Li, Yuan and Yao, Peisen and Yu, Kan and Wang, Chengpeng and Ye, Yaoyang and Li, Song and Luo, Meng and Liu, Yepang and Ren, Kui},
title = {Understanding Industry Perspectives of Static Application Security Testing (SAST) Evaluation},
journal = {Proceedings of the ACM on Software Engineering},
year = {2025},
volume = {2},
number = {FSE},
pages = {3033--3056},
doi = {10.1145/3729404}
}
EUVIMED