EUVIMEDObjevte EUVIMED
Crossref

The Current Challenges of Software Engineering in the Era of Large Language Models

Cuiyun Gao, Xing Hu, Shan Gao, Xin Xia, Zhi Jin

ACM Transactions on Software Engineering and Methodology · 2025-06-30 · 34 (5) · 1-30

DOI: 10.1145/3712005 ↗

At a glance

Journal article in ACM Transactions on Software Engineering and Methodology, published online on 2025-05-27. Written by Cuiyun Gao and 4 co-authors. Cited 67 times so far (Crossref); 193 references. Funded by: National Natural Science Foundation of China, Natural Science Foundation of Guangdong Province, Shenzhen-Hong Kong Jointly.

AbstraktBibliografické údajeCiteRelated studies

Abstract (original language)

With the advent of large language models (LLMs) in the AI area, the field of software engineering (SE) has also witnessed a paradigm shift. These models, by leveraging the power of deep learning and massive amounts of data, have demonstrated an unprecedented capacity to understand, generate, and operate programming languages. They can assist developers in completing a broad spectrum of software development activities, encompassing software design, automated programming, and maintenance, which potentially reduces huge human efforts. Integrating LLMs within the SE landscape (LLM4SE) has become a burgeoning trend, necessitating exploring this emergent landscape’s challenges and opportunities. The article aims at revisiting the software development lifecycle (SDLC) under LLMs, and highlighting challenges and opportunities of the new paradigm. The article first summarizes the overall process of LLM4SE, and then elaborates on the current challenges based on a through discussion. The discussion was held among more than 20 participants from academia and industry, specializing in fields such as SE and artificial intelligence. Specifically, we achieve 26 key challenges from seven aspects, including software requirement and design, coding assistance, testing code generation, code review, code maintenance, software vulnerability management, and data, training, and evaluation. We hope the achieved challenges would benefit future research in the LLM4SE field.

Funding

  • National Natural Science Foundation of China
  • Natural Science Foundation of Guangdong Province
  • Shenzhen-Hong Kong Jointly
  • Shenzhen Basic Research
  • Shenzhen International Science and Technology Cooperation
  • CCF-Huawei Populus Grove Fund

Cite

APA

Gao, C., Hu, X., Gao, S., Xia, X., & Jin, Z. (2025). The Current Challenges of Software Engineering in the Era of Large Language Models. ACM Transactions on Software Engineering and Methodology, 34(5), 1-30. https://doi.org/10.1145/3712005

Vancouver

Gao C, Hu X, Gao S, Xia X, Jin Z. The Current Challenges of Software Engineering in the Era of Large Language Models. ACM Transactions on Software Engineering and Methodology. 2025;34(5):1-30. doi:10.1145/3712005

BibTeX
@article{Gao2025,
  author = {Gao, Cuiyun and Hu, Xing and Gao, Shan and Xia, Xin and Jin, Zhi},
  title = {The Current Challenges of Software Engineering in the Era of Large Language Models},
  journal = {ACM Transactions on Software Engineering and Methodology},
  year = {2025},
  volume = {34},
  number = {5},
  pages = {1--30},
  doi = {10.1145/3712005}
}
Start for free →