More than Meets the Eye: On Evaluating SBOM Tools in Java
ACM Transactions on Software Engineering and Methodology · 31.07.2026 · 35 (7) · 1-30
DOI: 10.1145/3766073 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Software Engineering and Methodology, online erschienen am 17.06.2026. Verfasst von Menghan Wu und 5 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 121 Literaturangaben. Gefördert von: National Key R&D Program of China.
Abstract (Originalsprache)
Open source software is widely used in current software development. Unfortunately, this integration introduces a spectrum of challenges and potential threats. Such challenges emerge due to the diversity of import scenarios, which in turn may introduce malicious or vulnerable code in the client software, thereby causing significant security risks. To improve the transparency of software supply chains, Software Bill of Materials (SBOM) tools are proposed to identify the components within software systems. However, there is limit investigation of functionality (i.e., tool operational process and data fields) and their practical performance of SBOM tools across various import scenarios. In this article, we perform a comprehensive empirical study to investigate the impact of different import scenarios on SBOM tools. Specifically, we focus on three distinct component import scenarios: Build Tool Import, Dynamic Loading, and Source Code Import across a new benchmark consisting of 152 projects. We find that (1) the detection capabilities of SBOM tools exhibit considerable variance, especially in identifying dependency relationships, and (2) the effectiveness of SBOM tools within the import scenarios of Dynamic Loading and Source Code Import falls short of expectations. Based on our findings, we summarize the lessons learned from different perspectives, including practitioners, tool vendors, and researchers. Our study provides valuable insights into the intricate landscape of software component usage, contributing to enhancing SBOM tools in modern software development.
Förderung
- National Key R&D Program of China
Zitieren
APA
Wu, M., Zhao, Y., Hu, X., Zhan, X., Li, S., & Xia, X. (2026). More than Meets the Eye: On Evaluating SBOM Tools in Java. ACM Transactions on Software Engineering and Methodology, 35(7), 1-30. https://doi.org/10.1145/3766073
Vancouver
Wu M, Zhao Y, Hu X, Zhan X, Li S, Xia X. More than Meets the Eye: On Evaluating SBOM Tools in Java. ACM Transactions on Software Engineering and Methodology. 2026;35(7):1-30. doi:10.1145/3766073
BibTeX
@article{Wu2026,
author = {Wu, Menghan and Zhao, Yukai and Hu, Xing and Zhan, Xian and Li, Shanping and Xia, Xin},
title = {More than Meets the Eye: On Evaluating SBOM Tools in Java},
journal = {ACM Transactions on Software Engineering and Methodology},
year = {2026},
volume = {35},
number = {7},
pages = {1--30},
doi = {10.1145/3766073}
}
EUVIMED