EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Technology adoption performance evaluation applied to testing industrial REST APIs

Alexander Poth, Olsi Rrjolli, Andrea Arcuri

Automated Software Engineering · 2025-05 · 32 (1)

DOI: 10.1007/s10515-024-00477-2 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Automated Software Engineering, online erschienen am 02.12.2024. Verfasst von Alexander Poth und 2 weiteren Autor:innen. Beteiligte Einrichtung: Volkswagen AG, Wolfsburg, Germany. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Research Council, Kristiania University College.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Testing is an important task within software development. To write test cases and integrate them into an automated test suite requires a significant amount of work. Given a set of requirements and specifications of a software, testing is needed to verify its correctness. When done manually, it is an expensive and error prone task. To facilitate such work, automated test-case generation via tools could be useful. Test-case generation can be facilitated by deterministic algorithm-driven approaches or non-deterministic approaches such as with AI (e.g., evolutionary and LLM). The different approaches come with their strengths and weaknesses, which must be considered when integrating these approaches into a product test procedure in industry. Several novel testing techniques and tools have been developed in academia and industry, but how effective they are and how to integrate them in real-world large industrial scenarios is still unclear. In this paper, a systematic approach is presented to evaluate test-case generation methodologies and integrate them into a scalable enterprise setup. The specific context is black-box testing of REST APIs, based on their OpenAPI schemas. The aim is to facilitate IT product development and service delivery. The proposed Technology Adoption Performance Evaluation (TAPE) approach is evaluated by a case study within the Group IT of Volkswagen AG. We evaluated existing tools such as OpenAPI Generator, EvoMaster and StarCoder which are built on different technologies. Our results show that these tools are of benefit for test engineers to facilitate test-case specification and design within the Group IT of Volkswagen AG.

Schlagwörter

Stichwörter der Autor:innen

API validationBenchmarkingLLMQuality engineeringRequirements-based testingSBSTTest automationTest-case generation

Autor:innen und Institutionen

  • Volkswagen AG, Wolfsburg, Germany.
  • Kristiania and OsloMet, Oslo, Norway.

Förderung

  • European Research Council
  • Kristiania University College

Zitieren

APA

Poth, A., Rrjolli, O., & Arcuri, A. (2025). Technology adoption performance evaluation applied to testing industrial REST APIs. Automated Software Engineering, 32(1). https://doi.org/10.1007/s10515-024-00477-2

Vancouver

Poth A, Rrjolli O, Arcuri A. Technology adoption performance evaluation applied to testing industrial REST APIs. Automated Software Engineering. 2025;32(1). doi:10.1007/s10515-024-00477-2

BibTeX
@article{Poth2025,
  author = {Poth, Alexander and Rrjolli, Olsi and Arcuri, Andrea},
  title = {Technology adoption performance evaluation applied to testing industrial REST APIs},
  journal = {Automated Software Engineering},
  year = {2025},
  volume = {32},
  number = {1},
  doi = {10.1007/s10515-024-00477-2}
}
Kostenlos starten →