EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Reassessing CVSS Severity Classification with LightGBM and Operating System Metadata

Zhixiang Xu, Weihao Li, Zhiyong Zhou, Wenpei Zhang, Zi'an Yu, Mingming Li, Yunfei Yin

Applied Artificial Intelligence Research · 2026

DOI: 10.65455/451jd869 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Artificial Intelligence Research, 2026. Verfasst von Zhixiang Xu und 6 weiteren Autor:innen. Die Arbeit nennt 10 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

CVSS severity and observed exploitation are different prediction targets. This study reassesses a LightGBM pipeline using an available 1,314-record vulnerability dataset and explicitly defines its label as a CVSS score greater than 9. The original 98.48% accuracy is reproducible, but the pipeline encodes complete score-defining vectors and fits text features before splitting. We therefore remove identifiers and complete vectors, fit preprocessing only on training records, and compare five classifiers using parsed attack vector, TF-IDF text and two operating-system metadata features. After description deduplication, 882 records with CVE identifier years up to 2023 are used for training and 390 records from identifier year 2024 for testing. This is an identifier-year robustness check, not a disclosure-time evaluation. LightGBM achieves 95.64% accuracy, 41.67% recall, 0.8412 ROC-AUC and 0.4821 average precision; the majority baseline already achieves 93.85% accuracy. Adding operating-system metadata changes average precision by −0.0303 (paired bootstrap 95% interval −0.1077 to 0.0409), providing no consistent improvement. TreeSHAP dependence plots and error cases reveal strong reliance on attack vector and lexical associations. The results support a limited severity-classification case study and demonstrate why these data cannot establish real-world exploitability prediction.

Zitieren

APA

Xu, Z., Li, W., Zhou, Z., Zhang, W., Yu, Z., Li, M., & Yin, Y. (2026). Reassessing CVSS Severity Classification with LightGBM and Operating System Metadata. Applied Artificial Intelligence Research. https://doi.org/10.65455/451jd869

Vancouver

Xu Z, Li W, Zhou Z, Zhang W, Yu Z, Li M, et al. Reassessing CVSS Severity Classification with LightGBM and Operating System Metadata. Applied Artificial Intelligence Research. 2026. doi:10.65455/451jd869

BibTeX
@article{Xu2026,
  author = {Xu, Zhixiang and Li, Weihao and Zhou, Zhiyong and Zhang, Wenpei and Yu, Zi'an and Li, Mingming and Yin, Yunfei},
  title = {Reassessing CVSS Severity Classification with LightGBM and Operating System Metadata},
  journal = {Applied Artificial Intelligence Research},
  year = {2026},
  doi = {10.65455/451jd869}
}
Kostenlos starten →