EUVIMEDEUVIMED entdecken
Crossref

Test Oracle Generation for REST APIs

Juan C. Alonso, Michael D. Ernst, Sergio Segura, Antonio Ruiz-Cortés

ACM Transactions on Software Engineering and Methodology · 31.01.2026 · 35 (1) · 1-37

DOI: 10.1145/3726524 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Software Engineering and Methodology, online erschienen am 11.12.2025. Verfasst von Juan C. Alonso und 3 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 114 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The number and complexity of test case generation tools for REST APIs have significantly increased in recent years. These tools excel in automating input generation but are limited by their test oracles, which can only detect crashes, regressions, and violations of API specifications or design best practices. This article introduces AGORA+, an approach for generating test oracles for REST APIs through the detection of invariants—output properties that should always hold. AGORA+ learns the expected behavior of an API by analyzing API requests and their corresponding responses. We enhanced the Daikon tool for dynamic detection of likely invariants, adding new invariant types and creating a front-end called Beet. Beet translates any OpenAPI specification and a set of API requests and responses into Daikon inputs. AGORA+ can detect 106 different types of invariants in REST APIs. We also developed PostmanAssertify, which converts the invariants identified by AGORA+ into executable JavaScript assertions. AGORA+ achieved a precision of 80% on 25 operations from 20 industrial APIs. It also identified 48% of errors systematically seeded in the outputs of the APIs under test. AGORA+ uncovered 32 bugs in popular APIs, including Amadeus, Deutschebahn, GitHub, Marvel, NYTimesBooks, and YouTube, leading to fixes and documentation updates.

Zitieren

APA

Alonso, J. C., Ernst, M. D., Segura, S., & Ruiz-Cortés, A. (2026). Test Oracle Generation for REST APIs. ACM Transactions on Software Engineering and Methodology, 35(1), 1-37. https://doi.org/10.1145/3726524

Vancouver

Alonso JC, Ernst MD, Segura S, Ruiz-Cortés A. Test Oracle Generation for REST APIs. ACM Transactions on Software Engineering and Methodology. 2026;35(1):1-37. doi:10.1145/3726524

BibTeX
@article{Alonso2026,
  author = {Alonso, Juan C. and Ernst, Michael D. and Segura, Sergio and Ruiz-Cortés, Antonio},
  title = {Test Oracle Generation for REST APIs},
  journal = {ACM Transactions on Software Engineering and Methodology},
  year = {2026},
  volume = {35},
  number = {1},
  pages = {1--37},
  doi = {10.1145/3726524}
}
Kostenlos starten →