Significant Productivity Gains through Programming with Large Language Models
Proceedings of the ACM on Human-Computer Interaction · 17.06.2024 · 8 (EICS) · 1-29
DOI: 10.1145/3661145 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Human-Computer Interaction, online erschienen am 17.06.2024. Verfasst von Thomas Weber und 3 weiteren Autor:innen. Die Arbeit wurde bisher 72-mal zitiert (Crossref) und nennt 70 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Large language models like GPT and Codex drastically alter many daily tasks, including programming, where they can rapidly generate code from natural language or informal specifications. Thus, they will change what it means to be a programmer and how programmers act during software development. This work explores how AI assistance for code generation impacts productivity. In our user study (N=24), we asked programmers to complete Python programming tasks supported by a) an auto-complete interface using GitHub Copilot, b) a conversational system using GPT-3, and c) traditionally with just the web browser. Aside from significantly increasing productivity metrics, participants displayed distinctive usage patterns and strategies, highlighting that the form of presentation and interaction affects how users engage with these systems. Our findings emphasize the benefits of AI-assisted coding and highlight the different design challenges for these systems.
Zitieren
APA
Weber, T., Brandmaier, M., Schmidt, A., & Mayer, S. (2024). Significant Productivity Gains through Programming with Large Language Models. Proceedings of the ACM on Human-Computer Interaction, 8(EICS), 1-29. https://doi.org/10.1145/3661145
Vancouver
Weber T, Brandmaier M, Schmidt A, Mayer S. Significant Productivity Gains through Programming with Large Language Models. Proceedings of the ACM on Human-Computer Interaction. 2024;8(EICS):1-29. doi:10.1145/3661145
BibTeX
@article{Weber2024,
author = {Weber, Thomas and Brandmaier, Maximilian and Schmidt, Albrecht and Mayer, Sven},
title = {Significant Productivity Gains through Programming with Large Language Models},
journal = {Proceedings of the ACM on Human-Computer Interaction},
year = {2024},
volume = {8},
number = {EICS},
pages = {1--29},
doi = {10.1145/3661145}
}
EUVIMED