EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Understanding Industry Perspectives of Static Application Security Testing (SAST) Evaluation

Yuan Li, Peisen Yao, Kan Yu, Chengpeng Wang, Yaoyang Ye, Song Li, Meng Luo, Yepang Liu, Kui Ren

Proceedings of the ACM on Software Engineering · 19.06.2025 · 2 (FSE) · 3033-3056

DOI: 10.1145/3729404 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the ACM on Software Engineering, online erschienen am 19.06.2025. Verfasst von Yuan Li und 8 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 91 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Leading Innovative and Entrepreneur Team Introduction Program of Hangzhou.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The demand for automated security analysis techniques, specifically static application security testing (SAST), is steadily rising. Assessing the effectiveness of SAST tools is crucial for evaluating current techniques and inspiring future technical advancements. Regrettably, recent research suggests that existing benchmarks used for evaluation often fail to meet the industry’s needs, significantly impeding the adoption of SASTs in real-world scenarios. This paper presents a qualitative study to bridge this gap. We investigate why industrial professionals utilize SAST benchmarks, identify barriers to their usage, and explore potential improvements for existing benchmarks. Specifically, we conducted in-depth, semi-structured interviews with twenty industrial professionals possessing diverse field experience and backgrounds in security and product development. As the first comprehensive investigation of SAST evaluation from an industrial perspective, our findings would break down the barriers between academia and industry, providing valuable inspiration for designing better benchmarks and promoting new advances in SAST evaluation.

Förderung

  • National Natural Science Foundation of China
  • Leading Innovative and Entrepreneur Team Introduction Program of Hangzhou

Zitieren

APA

Li, Y., Yao, P., Yu, K., Wang, C., Ye, Y., Li, S., Luo, M., Liu, Y., & Ren, K. (2025). Understanding Industry Perspectives of Static Application Security Testing (SAST) Evaluation. Proceedings of the ACM on Software Engineering, 2(FSE), 3033-3056. https://doi.org/10.1145/3729404

Vancouver

Li Y, Yao P, Yu K, Wang C, Ye Y, Li S, et al. Understanding Industry Perspectives of Static Application Security Testing (SAST) Evaluation. Proceedings of the ACM on Software Engineering. 2025;2(FSE):3033-3056. doi:10.1145/3729404

BibTeX
@article{Li2025,
  author = {Li, Yuan and Yao, Peisen and Yu, Kan and Wang, Chengpeng and Ye, Yaoyang and Li, Song and Luo, Meng and Liu, Yepang and Ren, Kui},
  title = {Understanding Industry Perspectives of Static Application Security Testing (SAST) Evaluation},
  journal = {Proceedings of the ACM on Software Engineering},
  year = {2025},
  volume = {2},
  number = {FSE},
  pages = {3033--3056},
  doi = {10.1145/3729404}
}
Kostenlos starten →