EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Behavioral Insights of SARSA-Based Reinforcement Learning for IPv6 Intrusion Classification

April Firman Daru, Alauddin Maulana Hirzan, Zainab Senan Mahmod Attar Bashi, Fajriannoor Fanani

Revista de Informática Teórica e Aplicada · 10.08.2026 · 33 (4) · 68-81

DOI: 10.22456/2175-2745.148437 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Revista de Informática Teórica e Aplicada, online erschienen am 10.08.2026. Verfasst von April Firman Daru und 3 weiteren Autor:innen. Die Arbeit nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Intrusion Detection Systems (IDS) are crucial for network security, but traditional models like signature-based and supervised learning approaches require frequent updates or retraining. This study introduces a reinforcement learning-based IDS using SARSA for IPv6 intrusion detection. The SARSA agent with epsilon 0.1 (E-0.1) performed best: optimal detection at step 11, 193,453 correct and 25,014 incorrect actions, total reward 842,195, average reward 3.855 per epoch, outperforming E-0.5 and E-0.9. Furthermore, a comparison of Q-Table exploitation between Q-Learning and SARSA indicates that both algorithms yield similar results. However, SARSA is preferable in security contexts because its more realistic approach results in a lower false alarm rate. This behavioral distinction is demonstrated by a -1.2109 value difference and a substantially lower mean state value for SARSA (4.903) compared to the more optimistic Q-Learning (16.310). To ensure robustness, the results were validated using different random seeds, and E-0.1 consistently produced stable total rewards with minimal variance. Additionally, Shannon entropy confirmed the agent's stable decision-making behavior, where E-0.1 showed faster convergence, indicating efficient learning. Altogether, these findings suggest that the SARSA-based IDS offers a more adaptive and reliable solution for intrusion detection, particularly in dynamic IPv6 environments.

Zitieren

APA

Daru, A. F., Hirzan, A. M., Bashi, Z. S. M. A., & Fanani, F. (2026). Behavioral Insights of SARSA-Based Reinforcement Learning for IPv6 Intrusion Classification. Revista de Informática Teórica e Aplicada, 33(4), 68-81. https://doi.org/10.22456/2175-2745.148437

Vancouver

Daru AF, Hirzan AM, Bashi ZSMA, Fanani F. Behavioral Insights of SARSA-Based Reinforcement Learning for IPv6 Intrusion Classification. Revista de Informática Teórica e Aplicada. 2026;33(4):68-81. doi:10.22456/2175-2745.148437

BibTeX
@article{Daru2026,
  author = {Daru, April Firman and Hirzan, Alauddin Maulana and Bashi, Zainab Senan Mahmod Attar and Fanani, Fajriannoor},
  title = {Behavioral Insights of SARSA-Based Reinforcement Learning for IPv6 Intrusion Classification},
  journal = {Revista de Informática Teórica e Aplicada},
  year = {2026},
  volume = {33},
  number = {4},
  pages = {68--81},
  doi = {10.22456/2175-2745.148437}
}
Kostenlos starten →