EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Only diff Is Not Enough: Generating Commit Messages Leveraging Reasoning and Action of Large Language Model

Jiawei Li, David Faragó, Christian Petrov, Iftekhar Ahmed

Proceedings of the ACM on Software Engineering · 12.07.2024 · 1 (FSE) · 745-766

DOI: 10.1145/3643760 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the ACM on Software Engineering, online erschienen am 12.07.2024. Verfasst von Jiawei Li und 3 weiteren Autor:innen. Die Arbeit wurde bisher 34-mal zitiert (Crossref) und nennt 95 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Commit messages play a vital role in software development and maintenance. While previous research has introduced various Commit Message Generation (CMG) approaches, they often suffer from a lack of consideration for the broader software context associated with code changes. This limitation resulted in generated commit messages that contained insufficient information and were poorly readable. To address these shortcomings, we approached CMG as a knowledge-intensive reasoning task. We employed ReAct prompting with a cutting-edge Large Language Model (LLM) to generate high-quality commit messages. Our tool retrieves a wide range of software context information, enabling the LLM to create commit messages that are factually grounded and comprehensive. Additionally, we gathered commit message quality expectations from software practitioners, incorporating them into our approach to further enhance message quality. Human evaluation demonstrates the overall effectiveness of our CMG approach, which we named Omniscient Message Generator (OMG). It achieved an average improvement of 30.2% over human-written messages and a 71.6% improvement over state-of-the-art CMG methods.

Zitieren

APA

Li, J., Faragó, D., Petrov, C., & Ahmed, I. (2024). Only diff Is Not Enough: Generating Commit Messages Leveraging Reasoning and Action of Large Language Model. Proceedings of the ACM on Software Engineering, 1(FSE), 745-766. https://doi.org/10.1145/3643760

Vancouver

Li J, Faragó D, Petrov C, Ahmed I. Only diff Is Not Enough: Generating Commit Messages Leveraging Reasoning and Action of Large Language Model. Proceedings of the ACM on Software Engineering. 2024;1(FSE):745-766. doi:10.1145/3643760

BibTeX
@article{Li2024,
  author = {Li, Jiawei and Faragó, David and Petrov, Christian and Ahmed, Iftekhar},
  title = {Only diff Is Not Enough: Generating Commit Messages Leveraging Reasoning and Action of Large Language Model},
  journal = {Proceedings of the ACM on Software Engineering},
  year = {2024},
  volume = {1},
  number = {FSE},
  pages = {745--766},
  doi = {10.1145/3643760}
}
Kostenlos starten →