Exploring Data-Efficient Adaptation of Large Language Models for Code Generation
ACM Transactions on Software Engineering and Methodology · 31.07.2026 · 35 (7) · 1-24
DOI: 10.1145/3772721 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Software Engineering and Methodology, online erschienen am 11.07.2026. Verfasst von Xue Jiang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 76 Literaturangaben. Gefördert von: National Key R&D Program, National Natural Science Foundation of China, Major Program (JD) of Hubei Province.
Abstract (Originalsprache)
Although Large Language Models (LLMs) have made significant progress in code generation, they still struggle with code generation tasks in specific scenarios. These scenarios usually necessitate the adaptation of LLMs to fulfill specific needs, but the limited training data available in practice leads to poor code generation performance. Therefore, how to effectively adapt LLMs to new scenarios with few training data is a major challenge for current code generation. In this article, we propose a novel adaptation approach named Data-Efficient adaptation with Error-Driven Learning (DEED) for code generation. D EED leverages the errors made by LLMs as learning opportunities, using error revision to overcome their own shortcomings, thus achieving efficient learning. Specifically, D EED involves identifying error code generated by LLMs, employing S elf-Revise for code revision, optimizing the model with revised code, and iteratively adapting the process for continuous improvement. Experimental results show that, compared to other mainstream fine-tuning approaches, D EED achieves superior performance with few training data, showing an average relative improvement of 46.2% in Pass@1 on multiple code generation benchmarks. We also validate the effectiveness of S elf-Revise, which generates revised code that optimizes the model more efficiently compared to the code samples from datasets. Moreover, D EED consistently demonstrates strong performance across various LLMs, underscoring its applicability.
Förderung
- National Key R&D Program
- National Natural Science Foundation of China
- Major Program (JD) of Hubei Province
Zitieren
APA
Jiang, X., Dong, Y., Fan, Z., Jin, Z., Jiao, W., & Li, G. (2026). Exploring Data-Efficient Adaptation of Large Language Models for Code Generation. ACM Transactions on Software Engineering and Methodology, 35(7), 1-24. https://doi.org/10.1145/3772721
Vancouver
Jiang X, Dong Y, Fan Z, Jin Z, Jiao W, Li G. Exploring Data-Efficient Adaptation of Large Language Models for Code Generation. ACM Transactions on Software Engineering and Methodology. 2026;35(7):1-24. doi:10.1145/3772721
BibTeX
@article{Jiang2026,
author = {Jiang, Xue and Dong, Yihong and Fan, Zhiyuan and Jin, Zhi and Jiao, Wenpin and Li, Ge},
title = {Exploring Data-Efficient Adaptation of Large Language Models for Code Generation},
journal = {ACM Transactions on Software Engineering and Methodology},
year = {2026},
volume = {35},
number = {7},
pages = {1--24},
doi = {10.1145/3772721}
}
EUVIMED