EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

On the Use of Agentic Coding: An Empirical Study of Pull Requests on GitHub

Miku Watanabe, Hao Li, Yutaro Kashiwa, Brittany Reid, Hajimu Iida, Ahmed E. Hassan

ACM Transactions on Software Engineering and Methodology · 31.10.2026 · 35 (10) · 1-24

DOI: 10.1145/3798166 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Software Engineering and Methodology, online erschienen am 16.09.2026. Verfasst von Miku Watanabe und 5 weiteren Autor:innen. Die Arbeit wurde bisher 52-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Society for the Promotion of Science (JSPS) KAKENHI, JST Precursory Research for Embryonic Science and Technology, AIP Network Laboratory Accelerated Program.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large language models (LLMs) are increasingly being integrated into software development processes. The ability to generate code and submit pull requests with minimal human intervention, through the use of autonomous AI agents, is poised to become a standard practice. However, little is known about the practical usefulness of these pull requests and the extent to which their contributions are accepted in real-world projects. In this article, we empirically study 567 GitHub pull requests (PRs) generated using Claude Code, an agentic coding tool, across 157 diverse open source projects. Our analysis reveals that developers tend to rely on agents for tasks such as refactoring, documentation, and testing. The results indicate that 83.8% of these agent-assisted PRs are eventually accepted and merged by project maintainers, with 54.9% of the merged PRs being integrated without further modification. The remaining 45.1% require additional changes and benefit from human revisions, especially for bug fixes, documentation, and adherence to project-specific standards. These findings suggest that while agent-assisted PRs are largely acceptable, they still benefit from human oversight and refinement.

Förderung

  • Japan Society for the Promotion of Science (JSPS) KAKENHI
  • JST Precursory Research for Embryonic Science and Technology
  • AIP Network Laboratory Accelerated Program
  • Natural Sciences and Engineering Research Council of Canada

Zitieren

APA

Watanabe, M., Li, H., Kashiwa, Y., Reid, B., Iida, H., & Hassan, A. E. (2026). On the Use of Agentic Coding: An Empirical Study of Pull Requests on GitHub. ACM Transactions on Software Engineering and Methodology, 35(10), 1-24. https://doi.org/10.1145/3798166

Vancouver

Watanabe M, Li H, Kashiwa Y, Reid B, Iida H, Hassan AE. On the Use of Agentic Coding: An Empirical Study of Pull Requests on GitHub. ACM Transactions on Software Engineering and Methodology. 2026;35(10):1-24. doi:10.1145/3798166

BibTeX
@article{Watanabe2026,
  author = {Watanabe, Miku and Li, Hao and Kashiwa, Yutaro and Reid, Brittany and Iida, Hajimu and Hassan, Ahmed E.},
  title = {On the Use of Agentic Coding: An Empirical Study of Pull Requests on GitHub},
  journal = {ACM Transactions on Software Engineering and Methodology},
  year = {2026},
  volume = {35},
  number = {10},
  pages = {1--24},
  doi = {10.1145/3798166}
}
Kostenlos starten →