A Reinforcement Learning Approach to Guide Web Crawler to Explore Web Applications for Improving Code Coverage
Electronics · 19.01.2024 · 13 (2) · 427
DOI: 10.3390/electronics13020427 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 19.01.2024. Verfasst von Chien-Hung Liu und 2 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science and Technology Council (NSTC) of Taiwan.
Abstract (Originalsprache)
Web crawlers are widely used to automatically explore and test web applications. However, navigating the pages of a web application can be difficult due to dynamic page generation. In particular, the inputs for the web form fields can affect the resulting pages and subsequent navigation. Therefore, choosing the inputs and the order of clicks on a web page is essential for an effective web crawler to achieve high code coverage. This paper proposes a set of actions to quickly fill in web form fields and uses reinforcement learning algorithms to train a convolutional neural network (CNN). The trained agent, named iRobot, can autonomously select actions to guide the web crawler to maximize code coverage. We experimentally compared different reinforcement learning algorithms, neural networks, and actions. The results show that our CNN network with the proposed actions performs better than other neural networks in terms of branch coverage using the Deep Q-learning (DQN) or proximal policy optimization (PPO) algorithm. Furthermore, compared to previous studies, iRobot can increase branch coverage by about 1.7% while reducing training time to 12.54%.
Förderung
- National Science and Technology Council (NSTC) of Taiwan
Zitieren
APA
Liu, C., You, S. D., & Chiu, Y. (2024). A Reinforcement Learning Approach to Guide Web Crawler to Explore Web Applications for Improving Code Coverage. Electronics, 13(2), 427. https://doi.org/10.3390/electronics13020427
Vancouver
Liu C, You SD, Chiu Y. A Reinforcement Learning Approach to Guide Web Crawler to Explore Web Applications for Improving Code Coverage. Electronics. 2024;13(2):427. doi:10.3390/electronics13020427
BibTeX
@article{Liu2024,
author = {Liu, Chien-Hung and You, Shingchern D. and Chiu, Ying-Chieh},
title = {A Reinforcement Learning Approach to Guide Web Crawler to Explore Web Applications for Improving Code Coverage},
journal = {Electronics},
year = {2024},
volume = {13},
number = {2},
pages = {427},
doi = {10.3390/electronics13020427}
}
EUVIMED