Large Language Models for Software Engineering: A Systematic Literature Review
ACM Transactions on Software Engineering and Methodology · 30.11.2024 · 33 (8) · 1-79
DOI: 10.1145/3695988 ↗Kurz gefasst
Systematische Übersicht in der Zeitschrift ACM Transactions on Software Engineering and Methodology, online erschienen am 03.12.2024. Verfasst von Xinyi Hou und 9 weiteren Autor:innen. Die Arbeit wurde bisher 1102-mal zitiert (Crossref) und nennt 575 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Key R&D Program of Hubei, National Research Foundation, under its Investigatorship.
Abstract (Originalsprache)
Large Language Models (LLMs) have significantly impacted numerous domains, including Software Engineering (SE). Many recent publications have explored LLMs applied to various SE tasks. Nevertheless, a comprehensive understanding of the application, effects, and possible limitations of LLMs on SE is still in its early stages. To bridge this gap, we conducted a Systematic Literature Review (SLR) on LLM4SE, with a particular focus on understanding how LLMs can be exploited to optimize processes and outcomes. We selected and analyzed 395 research articles from January 2017 to January 2024 to answer four key Research Questions (RQs). In RQ1, we categorize different LLMs that have been employed in SE tasks, characterizing their distinctive features and uses. In RQ2, we analyze the methods used in data collection, pre-processing, and application, highlighting the role of well-curated datasets for successful LLM for SE implementation. RQ3 investigates the strategies employed to optimize and evaluate the performance of LLMs in SE. Finally, RQ4 examines the specific SE tasks where LLMs have shown success to date, illustrating their practical contributions to the field. From the answers to these RQs, we discuss the current state-of-the-art and trends, identifying gaps in existing research, and highlighting promising areas for future study. Our artifacts are publicly available at https://github.com/security-pride/LLM4SE_SLR .
Förderung
- National Natural Science Foundation of China
- Key R&D Program of Hubei
- National Research Foundation, under its Investigatorship
Zitieren
APA
Hou, X., Zhao, Y., Liu, Y., Yang, Z., Wang, K., Li, L., Luo, X., Lo, D., Grundy, J., & Wang, H. (2024). Large Language Models for Software Engineering: A Systematic Literature Review. ACM Transactions on Software Engineering and Methodology, 33(8), 1-79. https://doi.org/10.1145/3695988
Vancouver
Hou X, Zhao Y, Liu Y, Yang Z, Wang K, Li L, et al. Large Language Models for Software Engineering: A Systematic Literature Review. ACM Transactions on Software Engineering and Methodology. 2024;33(8):1-79. doi:10.1145/3695988
BibTeX
@article{Hou2024,
author = {Hou, Xinyi and Zhao, Yanjie and Liu, Yue and Yang, Zhou and Wang, Kailong and Li, Li and Luo, Xiapu and Lo, David and Grundy, John and Wang, Haoyu},
title = {Large Language Models for Software Engineering: A Systematic Literature Review},
journal = {ACM Transactions on Software Engineering and Methodology},
year = {2024},
volume = {33},
number = {8},
pages = {1--79},
doi = {10.1145/3695988}
}
EUVIMED