EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Analysis of Autonomous Penetration Testing Through Reinforcement Learning and Recommender Systems

Ariadna Claudia Moreno iD, Aldo Hernandez-Suarez iD, Gabriel Sanchez-Perez iD, Linda Karina Toscano-Medina iD, Hector Perez-Meana iD, Jose Portillo-Portillo iD, Jesus Olivares-Mercado iD, Luis Javier García Villalba iD

Sensors · 02.01.2025 · 25 (1) · 211

DOI: 10.3390/s25010211 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 02.01.2025. Verfasst von Ariadna Claudia Moreno und 7 weiteren Autor:innen. Beteiligte Einrichtung: Instituto Politecnico Nacional, ESIME Culhuacan, Mexico City 04440, Mexico. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 56 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Conducting penetration testing (pentesting) in cybersecurity is a crucial turning point for identifying vulnerabilities within the framework of Information Technology (IT), where real malicious offensive behavior is simulated to identify potential weaknesses and strengthen preventive controls. Given the complexity of the tests, time constraints, and the specialized level of expertise required for pentesting, analysis and exploitation tools are commonly used. Although useful, these tools often introduce uncertainty in findings, resulting in high rates of false positives. To enhance the effectiveness of these tests, Machine Learning (ML) has been integrated, showing significant potential for identifying anomalies across various security areas through detailed detection of underlying malicious patterns. However, pentesting environments are unpredictable and intricate, requiring analysts to make extensive efforts to understand, explore, and exploit them. This study considers these challenges, proposing a recommendation system based on a context-rich, vocabulary-aware transformer capable of processing questions related to the target environment and offering responses based on necessary pentest batteries evaluated by a Reinforcement Learning (RL) estimator. This RL component assesses optimal attack strategies based on previously learned data and dynamically explores additional attack vectors. The system achieved an F1 score and an Exact Match rate over 97.0%, demonstrating its accuracy and effectiveness in selecting relevant pentesting strategies.

Schlagwörter

Stichwörter der Autor:innen

penetration testingrecommender systemsreinforcement learning

Autor:innen und Institutionen

  • Instituto Politecnico Nacional, ESIME Culhuacan, Mexico City 04440, Mexico.
  • Group of Analysis, Security and Systems (GASS), Department of Software Engineering and Artificial Intelligence (DISIA), Faculty of Computer Science and Engineering, Office 431, Universidad Complutense de Madrid (UCM), C…

ORCID-Profile: Ariadna Claudia Moreno, Aldo Hernandez-Suarez, Gabriel Sanchez-Perez, Linda Karina Toscano-Medina, Hector Perez-Meana, Jose Portillo-Portillo, Jesus Olivares-Mercado, Luis Javier García Villalba

Zitieren

APA

Moreno, A. C., Hernandez-Suarez, A., Sanchez-Perez, G., Toscano-Medina, L. K., Perez-Meana, H., Portillo-Portillo, J., Olivares-Mercado, J., & García Villalba, L. J. (2025). Analysis of Autonomous Penetration Testing Through Reinforcement Learning and Recommender Systems. Sensors, 25(1), 211. https://doi.org/10.3390/s25010211

Vancouver

Moreno AC, Hernandez-Suarez A, Sanchez-Perez G, Toscano-Medina LK, Perez-Meana H, Portillo-Portillo J, et al. Analysis of Autonomous Penetration Testing Through Reinforcement Learning and Recommender Systems. Sensors. 2025;25(1):211. doi:10.3390/s25010211

BibTeX
@article{Moreno2025,
  author = {Moreno, Ariadna Claudia and Hernandez-Suarez, Aldo and Sanchez-Perez, Gabriel and Toscano-Medina, Linda Karina and Perez-Meana, Hector and Portillo-Portillo, Jose and Olivares-Mercado, Jesus and García Villalba, Luis Javier},
  title = {Analysis of Autonomous Penetration Testing Through Reinforcement Learning and Recommender Systems},
  journal = {Sensors},
  year = {2025},
  volume = {25},
  number = {1},
  pages = {211},
  doi = {10.3390/s25010211}
}
Kostenlos starten →