Automated Test Generation Using Large Language Models
Data · 30.09.2025 · 10 (10) · 156
DOI: 10.3390/data10100156 ↗Kurz gefasst
Fachartikel in der Zeitschrift Data, online erschienen am 30.09.2025. Verfasst von Marcin Andrzejewski und 4 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Capgemini.
Abstract (Originalsprache)
This study explores the potential of generative AI, specifically Large Language Models (LLMs), in automating unit test generation in Python 3.13. We analyze tests, both those created by programmers and those generated by LLM models, for fifty source code cases. Our main focus is on how the choice of model, the difficulty of the source code, and the prompting strategy influence the quality of the generated tests. The results show that AI models can help automate test creation for simple code, but their effectiveness decreases for more complex tasks. We introduce an embedding-based similarity analysis to assess how closely AI-generated tests resemble human-written ones, revealing that AI outputs often lack semantic diversity. The study also highlights the potential of AI models for rapid test prototyping, which can significantly speed up the software development cycle. However, further customization and training of the models on specific use cases is needed to achieve greater precision. Our findings provide practical insights into integrating LLMs into software testing workflows and emphasize the importance of prompt design and model selection.
Förderung
- Capgemini
Zitieren
APA
Andrzejewski, M., Dubicka, N., Podolak, J., Kowal, M., & Siłka, J. (2025). Automated Test Generation Using Large Language Models. Data, 10(10), 156. https://doi.org/10.3390/data10100156
Vancouver
Andrzejewski M, Dubicka N, Podolak J, Kowal M, Siłka J. Automated Test Generation Using Large Language Models. Data. 2025;10(10):156. doi:10.3390/data10100156
BibTeX
@article{Andrzejewski2025,
author = {Andrzejewski, Marcin and Dubicka, Nina and Podolak, Jędrzej and Kowal, Marek and Siłka, Jakub},
title = {Automated Test Generation Using Large Language Models},
journal = {Data},
year = {2025},
volume = {10},
number = {10},
pages = {156},
doi = {10.3390/data10100156}
}
EUVIMED