EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

GPT‐Monkey: Enhancing Automated GUI Testing for Android Apps via LLM‐Driven Interface Understanding and Function Segmentation

Zhanhui Yuan, Kai Chen, Zhi Yang, Dongxue Jiang, Jinglei Tan, Hongqi Zhang

IET Software · 2026-01 · 2026 (1)

DOI: 10.1049/sfw2/9976714 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IET Software, online erschienen am 04.06.2026. Verfasst von Zhanhui Yuan und 5 weiteren Autor:innen. Die Arbeit nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, China Postdoctoral Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Automated graphical user interface (GUI) testing is essential for ensuring mobile app quality. However, existing related methods lack deep GUI understanding and cannot segment specific functions for targeted testing, resulting in wasted test events and low efficiency. This study aims to leverage large language models (LLMs) to enhance Monkey‐based GUI testing by enabling function‐level segmentation and tailored parameter generation driven by user requirements. We propose GPT‐Monkey, which integrates Monkey’s randomness with LLM’s understanding capability. It establishes global interface associations and cross‐modal alignment for LLM‐driven function segmentation, employs parameter‐retrieval augmented generation (RAG) to guide tailored parameter generation, and adopts a dual‐feedback mechanism to iteratively optimize testing. Experiments show that GPT‐Monkey improves crash detection by 16.7% and efficiency by 34.5% over the optimal baseline, and achieves 95% function segmentation accuracy and uncovers 397 real‐world crashes on 1000 Google Play apps. The results demonstrate that LLM‐driven function segmentation and tailored parameter generation significantly enhance the precision and efficiency of automated GUI testing.

Förderung

  • National Natural Science Foundation of China
  • China Postdoctoral Science Foundation

Zitieren

APA

Yuan, Z., Chen, K., Yang, Z., Jiang, D., Tan, J., & Zhang, H. (2026). GPT‐Monkey: Enhancing Automated GUI Testing for Android Apps via LLM‐Driven Interface Understanding and Function Segmentation. IET Software, 2026(1). https://doi.org/10.1049/sfw2/9976714

Vancouver

Yuan Z, Chen K, Yang Z, Jiang D, Tan J, Zhang H. GPT‐Monkey: Enhancing Automated GUI Testing for Android Apps via LLM‐Driven Interface Understanding and Function Segmentation. IET Software. 2026;2026(1). doi:10.1049/sfw2/9976714

BibTeX
@article{Yuan2026,
  author = {Yuan, Zhanhui and Chen, Kai and Yang, Zhi and Jiang, Dongxue and Tan, Jinglei and Zhang, Hongqi},
  title = {GPT‐Monkey: Enhancing Automated GUI Testing for Android Apps via LLM‐Driven Interface Understanding and Function Segmentation},
  journal = {IET Software},
  year = {2026},
  volume = {2026},
  number = {1},
  doi = {10.1049/sfw2/9976714}
}
Kostenlos starten →