EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

Design Problems, Decisions, and Evidence in Agentic Software Engineering: A Systematic Mapping Study

Jorge Díaz-Villegas, Zihao Xiao, Ania Cravero

Electronics · 2026-11-04 · 15 (21) · 5121

DOI: 10.3390/electronics15215121 ↗

At a glance

Journal article in Electronics, published online on 2026-11-04. Written by Jorge Díaz-Villegas and 2 co-authors. 113 references. The full text is freely available (open access, CC BY 4.0).

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Agentic Software Engineering (ASE) systems depend on decisions about context, reasoning, coordination, tool use, execution, and verification. This systematic mapping study maps problems, design decisions, operationalizations, and evidence in peer-reviewed studies of LLM- or foundation-model-based agentic systems in Software Engineering from 1 January 2024 to 13 July 2026. ACM Digital Library, IEEE Xplore, Scopus, and Springer Nature Link were searched on 13 July 2026 using the same Boolean string. From 1069 records, 94 studies were included. A frozen, single-paper-isolated extraction protocol identified 1018 design decisions, followed by deterministic multi-label synthesis; no formal study-level risk-of-bias assessment was performed. Of these decisions, 633 were linked to 656 problems or objectives, and 913 (89.7%) had empirical or comparative evaluation records. Only 19.8% of evaluation records attributed evidence to an individual decision, whereas 52.3% assessed complete systems; multi-agent configurations represented 68.7% of problem-linked decisions. Heterogeneous metrics and system-level evaluation limit inference about effectiveness. The findings expose a gap between evaluation coverage and decision-level attribution and motivate ablations and human-centered evaluations. The review received no external funding and was not registered.

Cite

APA

Díaz-Villegas, J., Xiao, Z., & Cravero, A. (2026). Design Problems, Decisions, and Evidence in Agentic Software Engineering: A Systematic Mapping Study. Electronics, 15(21), 5121. https://doi.org/10.3390/electronics15215121

Vancouver

Díaz-Villegas J, Xiao Z, Cravero A. Design Problems, Decisions, and Evidence in Agentic Software Engineering: A Systematic Mapping Study. Electronics. 2026;15(21):5121. doi:10.3390/electronics15215121

BibTeX
@article{DazVillegas2026,
  author = {Díaz-Villegas, Jorge and Xiao, Zihao and Cravero, Ania},
  title = {Design Problems, Decisions, and Evidence in Agentic Software Engineering: A Systematic Mapping Study},
  journal = {Electronics},
  year = {2026},
  volume = {15},
  number = {21},
  pages = {5121},
  doi = {10.3390/electronics15215121}
}
Start for free →