Generative AI for Pull Request Descriptions: Adoption, Impact, and Developer Interventions
Proceedings of the ACM on Software Engineering · 12.07.2024 · 1 (FSE) · 1043-1065
DOI: 10.1145/3643773 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Software Engineering, online erschienen am 12.07.2024. Verfasst von Tao Xiao und 3 weiteren Autor:innen. Die Arbeit wurde bisher 32-mal zitiert (Crossref) und nennt 72 Literaturangaben. Gefördert von: Japan Society for the Promotion of Science, Japan Science and Technology Agency.
Abstract (Originalsprache)
GitHub’s Copilot for Pull Requests (PRs) is a promising service aiming to automate various developer tasks related to PRs, such as generating summaries of changes or providing complete walkthroughs with links to the relevant code. As this innovative technology gains traction in the Open Source Software (OSS) community, it is crucial to examine its early adoption and its impact on the development process. Additionally, it offers a unique opportunity to observe how developers respond when they disagree with the generated content. In our study, we employ a mixed-methods approach, blending quantitative analysis with qualitative insights, to examine 18,256 PRs in which parts of the descriptions were crafted by generative AI. Our findings indicate that: (1) Copilot for PRs, though in its infancy, is seeing a marked uptick in adoption. (2) PRs enhanced by Copilot for PRs require less review time and have a higher likelihood of being merged. (3) Developers using Copilot for PRs often complement the automated descriptions with their manual input. These results offer valuable insights into the growing integration of generative AI in software development.
Förderung
- Japan Society for the Promotion of Science
- Japan Science and Technology Agency
Zitieren
APA
Xiao, T., Hata, H., Treude, C., & Matsumoto, K. (2024). Generative AI for Pull Request Descriptions: Adoption, Impact, and Developer Interventions. Proceedings of the ACM on Software Engineering, 1(FSE), 1043-1065. https://doi.org/10.1145/3643773
Vancouver
Xiao T, Hata H, Treude C, Matsumoto K. Generative AI for Pull Request Descriptions: Adoption, Impact, and Developer Interventions. Proceedings of the ACM on Software Engineering. 2024;1(FSE):1043-1065. doi:10.1145/3643773
BibTeX
@article{Xiao2024,
author = {Xiao, Tao and Hata, Hideaki and Treude, Christoph and Matsumoto, Kenichi},
title = {Generative AI for Pull Request Descriptions: Adoption, Impact, and Developer Interventions},
journal = {Proceedings of the ACM on Software Engineering},
year = {2024},
volume = {1},
number = {FSE},
pages = {1043--1065},
doi = {10.1145/3643773}
}
EUVIMED