Sweat the Details: Exercise Breaks and AI Assistance in Code Summarization
IEEE Transactions on Software Engineering · 2026-11 · 52 (11) · 3337-3349
DOI: 10.1109/tse.2026.3716079 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Software Engineering, 2026-11. Verfasst von Amy Wei und 2 weiteren Autor:innen. Gefördert von: U.S. National Science Foundation.
Abstract (Originalsprache)
—Code summarization supports program comprehension and defect detection, and developers increasingly use both human-centered and AI-based interventions when performing this task. We present a controlled human-subjects study ( N = 47 ) examining the effects of physical exercise and AI-generated code summaries with varying correctness on developers’ summarization and bug detection performance. Participants summarized GitHub code under different intervention conditions, with outcomes evaluated along multiple dimensions, including accuracy, completeness, conciseness, readability, defect detection, and response time. We analyzed the data using mixed-effects models to account for repeated measures across participants and code artifacts. Surprisingly, under the exercise intervention studied, we did not observe consistent benefits for summarization quality. AI assistance is generally useful for code summarization, but incorrect AI assistance substantially degrades bug detection performance. These findings provide empirical evidence on the nuanced benefits and risks of human-and tool-based interventions in code summarization and bug detection.
Förderung
- U.S. National Science Foundation
Zitieren
APA
Wei, A., Santiesteban, P., & Weimer, W. (2026). Sweat the Details: Exercise Breaks and AI Assistance in Code Summarization. IEEE Transactions on Software Engineering, 52(11), 3337-3349. https://doi.org/10.1109/tse.2026.3716079
Vancouver
Wei A, Santiesteban P, Weimer W. Sweat the Details: Exercise Breaks and AI Assistance in Code Summarization. IEEE Transactions on Software Engineering. 2026;52(11):3337-3349. doi:10.1109/tse.2026.3716079
BibTeX
@article{Wei2026,
author = {Wei, Amy and Santiesteban, Priscila and Weimer, Westley},
title = {Sweat the Details: Exercise Breaks and AI Assistance in Code Summarization},
journal = {IEEE Transactions on Software Engineering},
year = {2026},
volume = {52},
number = {11},
pages = {3337--3349},
doi = {10.1109/tse.2026.3716079}
}
EUVIMED