Towards Modeling Human Attention from Eye Movements for Neural Source Code Summarization
Proceedings of the ACM on Human-Computer Interaction · 17.05.2023 · 7 (ETRA) · 1-19
DOI: 10.1145/3591136 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Human-Computer Interaction, online erschienen am 18.05.2023. Verfasst von Aakash Bansal und 2 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 62 Literaturangaben. Gefördert von: NSF.
Abstract (Originalsprache)
Neural source code summarization is the task of generating natural language descriptions of source code behavior using neural networks. A fundamental component of most neural models is an attention mechanism. The attention mechanism learns to connect features in source code to specific words to use when generating natural language descriptions. Humans also pay attention to some features in code more than others. This human attention reflects experience and high-level cognition well beyond the capability of any current neural model. In this paper, we use data from published eye-tracking experiments to create a model of this human attention. The model predicts which words in source code are the most important for code summarization. Next, we augment a baseline neural code summarization approach using our model of human attention. We observe an improvement in prediction performance of the augmented approach in line with other bio-inspired neural models.
Förderung
- NSF
Zitieren
APA
Bansal, A., Sharif, B., & McMillan, C. (2023). Towards Modeling Human Attention from Eye Movements for Neural Source Code Summarization. Proceedings of the ACM on Human-Computer Interaction, 7(ETRA), 1-19. https://doi.org/10.1145/3591136
Vancouver
Bansal A, Sharif B, McMillan C. Towards Modeling Human Attention from Eye Movements for Neural Source Code Summarization. Proceedings of the ACM on Human-Computer Interaction. 2023;7(ETRA):1-19. doi:10.1145/3591136
BibTeX
@article{Bansal2023,
author = {Bansal, Aakash and Sharif, Bonita and McMillan, Collin},
title = {Towards Modeling Human Attention from Eye Movements for Neural Source Code Summarization},
journal = {Proceedings of the ACM on Human-Computer Interaction},
year = {2023},
volume = {7},
number = {ETRA},
pages = {1--19},
doi = {10.1145/3591136}
}
EUVIMED