EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Reinforcement Learning Approach to Guide Web Crawler to Explore Web Applications for Improving Code Coverage

Chien-Hung Liu, Shingchern D. You, Ying-Chieh Chiu

Electronics · 19.01.2024 · 13 (2) · 427

DOI: 10.3390/electronics13020427 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 19.01.2024. Verfasst von Chien-Hung Liu und 2 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science and Technology Council (NSTC) of Taiwan.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Web crawlers are widely used to automatically explore and test web applications. However, navigating the pages of a web application can be difficult due to dynamic page generation. In particular, the inputs for the web form fields can affect the resulting pages and subsequent navigation. Therefore, choosing the inputs and the order of clicks on a web page is essential for an effective web crawler to achieve high code coverage. This paper proposes a set of actions to quickly fill in web form fields and uses reinforcement learning algorithms to train a convolutional neural network (CNN). The trained agent, named iRobot, can autonomously select actions to guide the web crawler to maximize code coverage. We experimentally compared different reinforcement learning algorithms, neural networks, and actions. The results show that our CNN network with the proposed actions performs better than other neural networks in terms of branch coverage using the Deep Q-learning (DQN) or proximal policy optimization (PPO) algorithm. Furthermore, compared to previous studies, iRobot can increase branch coverage by about 1.7% while reducing training time to 12.54%.

Förderung

  • National Science and Technology Council (NSTC) of Taiwan

Zitieren

APA

Liu, C., You, S. D., & Chiu, Y. (2024). A Reinforcement Learning Approach to Guide Web Crawler to Explore Web Applications for Improving Code Coverage. Electronics, 13(2), 427. https://doi.org/10.3390/electronics13020427

Vancouver

Liu C, You SD, Chiu Y. A Reinforcement Learning Approach to Guide Web Crawler to Explore Web Applications for Improving Code Coverage. Electronics. 2024;13(2):427. doi:10.3390/electronics13020427

BibTeX
@article{Liu2024,
  author = {Liu, Chien-Hung and You, Shingchern D. and Chiu, Ying-Chieh},
  title = {A Reinforcement Learning Approach to Guide Web Crawler to Explore Web Applications for Improving Code Coverage},
  journal = {Electronics},
  year = {2024},
  volume = {13},
  number = {2},
  pages = {427},
  doi = {10.3390/electronics13020427}
}
Kostenlos starten →