L-ARLPT: An LLM-Augmented Reinforcement Learning Framework for Autonomous Penetration Testing
Applied Sciences · 07.08.2026 · 16 (16) · 7887
DOI: 10.3390/app16167887 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 07.08.2026. Verfasst von Rufeng Zhan und 5 weiteren Autor:innen. Die Arbeit nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
In recent years, Deep Reinforcement Learning (DRL) has emerged as a promising approach for automating penetration testing due to its capability to perform sequential decision-making in complex environments. However, in real-world enterprise networks, attack actions are typically characterized by highly coupled multi-dimensional parameter combinations, resulting in an exponentially expanding discrete action space. Such a large action space significantly degrades exploration efficiency and prevents conventional DRL agents from learning effective attack paths under sparse-reward conditions. To address these challenges, this paper proposes a Large Language Model-enhanced Autonomous Reinforcement Learning Penetration Testing framework (L-ARLPT). Specifically, the framework leverages the domain knowledge embedded in a Large Language Model (LLM) to perform tactical planning, thereby pruning the original action space into a compact set of candidate actions. Subsequently, an experience-driven layer employs the optimization mechanism of a Deep Q-Network (DQN) to conduct value estimation and policy learning within the reduced candidate set. To validate the effectiveness of the proposed framework, a high-fidelity enterprise penetration-testing simulation environment was constructed based on realistic enterprise attack scenarios. Experimental results demonstrate that, in a high-fidelity enterprise penetration-testing environment with a raw theoretical parameter-combination space containing 6×107 combinations, the proposed L-ARLPT framework achieves an average penetration depth of 3.33 out of 4.00, substantially outperforming both reinforcement learning baselines (all ≤1.27) and LLM-based baselines (1.12). Moreover, successful episodes require only 128.43 decision steps on average, enabling long-horizon, cross-domain lateral penetration in high-dimensional discrete action spaces.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Zhan, R., Zhu, J., Xu, Y., Chen, C., Hu, R., & Wang, L. (2026). L-ARLPT: An LLM-Augmented Reinforcement Learning Framework for Autonomous Penetration Testing. Applied Sciences, 16(16), 7887. https://doi.org/10.3390/app16167887
Vancouver
Zhan R, Zhu J, Xu Y, Chen C, Hu R, Wang L. L-ARLPT: An LLM-Augmented Reinforcement Learning Framework for Autonomous Penetration Testing. Applied Sciences. 2026;16(16):7887. doi:10.3390/app16167887
BibTeX
@article{Zhan2026,
author = {Zhan, Rufeng and Zhu, Junyi and Xu, Yinghui and Chen, Chan and Hu, Rongxin and Wang, Le},
title = {L-ARLPT: An LLM-Augmented Reinforcement Learning Framework for Autonomous Penetration Testing},
journal = {Applied Sciences},
year = {2026},
volume = {16},
number = {16},
pages = {7887},
doi = {10.3390/app16167887}
}
EUVIMED