EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

RippleGUItester: Change-Aware Exploratory Testing

Yanqi Su, Michael Pradel, Chunyang Chen

Proceedings of the ACM on Software Engineering · 01.10.2026 · 3 (ISSTA) · 3411-3432

DOI: 10.1145/3832240 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the ACM on Software Engineering, online erschienen am 01.10.2026. Verfasst von Yanqi Su und 2 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: German Research Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Software systems evolve continuously through frequent code changes, yet such changes often introduce unintended bugs despite extensive testing and code review. Existing testing approaches are largely constrained to predefined execution paths or rely on unguided exploration, leaving many change-induced issues undetected. To address this challenge, we present RippleGUItester, a change-driven testing system that treats a code change as the epicenter of a ripple effect and explores its broader, user-visible impacts via the GUI. Given a code change, RippleGUItester performs LLM-based change-impact analysis to generate and enrich realistic test scenarios, executes these scenarios on both pre-change and post-change versions of the system, and applies differential analysis to identify behavioral differences. Crucially, RippleGUItester employs multimodal bug detection, comparing visual GUI changes and interpreting them in the context of natural-language change intents to distinguish unintended bugs from intended behavioral updates. We evaluate our approach on hundreds of real-world code changes across four widely used software systems: Firefox, Zettlr, JabRef, and Godot. Our results show that the proposed approach uncovers bugs introduced by code changes that were missed by existing test suites, CI pipelines, and code review. In total, we identify and report 26 previously unknown bugs that still exist in the latest versions of the evaluated systems. 18 bugs have been fixed, 3 have been confirmed, and 5 were marked as intended. We envision RippleGUItester being applied before or shortly after a code change is merged, enabling earlier detection of regressions.

Förderung

  • German Research Foundation

Zitieren

APA

Su, Y., Pradel, M., & Chen, C. (2026). RippleGUItester: Change-Aware Exploratory Testing. Proceedings of the ACM on Software Engineering, 3(ISSTA), 3411-3432. https://doi.org/10.1145/3832240

Vancouver

Su Y, Pradel M, Chen C. RippleGUItester: Change-Aware Exploratory Testing. Proceedings of the ACM on Software Engineering. 2026;3(ISSTA):3411-3432. doi:10.1145/3832240

BibTeX
@article{Su2026,
  author = {Su, Yanqi and Pradel, Michael and Chen, Chunyang},
  title = {RippleGUItester: Change-Aware Exploratory Testing},
  journal = {Proceedings of the ACM on Software Engineering},
  year = {2026},
  volume = {3},
  number = {ISSTA},
  pages = {3411--3432},
  doi = {10.1145/3832240}
}
Kostenlos starten →