Beyond Efficiency: A Systematic Survey of Resource-Efficient Large Language Models
ACM Computing Surveys · 31.12.2026 · 58 (16) · 1-45
DOI: 10.1145/3845797 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 12.10.2026. Verfasst von Guangji Bai und 13 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 274 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Office of Advanced Cyberinfrastructure, National Institutes of Health.
Abstract (Originalsprache)
The burgeoning field of Large Language Models (LLMs), exemplified by sophisticated models like OpenAI’s ChatGPT, represents a significant advancement in artificial intelligence. These models, however, bring forth substantial challenges in high consumption of computational, memory, energy, and financial resources, especially in environments with limited resource capabilities. This survey aims to systematically address these challenges by reviewing a broad spectrum of techniques designed to enhance the resource efficiency of LLMs. We categorize methods based on their optimization focus—covering computational, memory, energy, financial, and network resources—and their applicability across various stages of an LLM’s lifecycle, including architecture design, pre-training, fine-tuning, and system design. Additionally, the survey introduces a nuanced categorization of resource efficiency techniques by their specific resource types, which uncovers the intricate relationships and mappings between various resources and corresponding optimization techniques. A standardized set of evaluation metrics and datasets is also presented to facilitate consistent and fair comparisons across different models and techniques. By offering a comprehensive overview of the current state-of-the-art and identifying open research avenues, this survey serves as a foundational reference for researchers and practitioners, aiding them in developing more sustainable and efficient LLMs in a rapidly evolving landscape. To make the field more accessible to interested beginners, we not only make a systematic review of existing works and a highly structured taxonomy of resource-efficient LLMs but also release a website including a constantly-updated article list https://github.com/tiingweii-shii/Awesome-Resource-Efficient-LLM-Papers.
Förderung
- Office of Advanced Cyberinfrastructure
- National Institutes of Health
Zitieren
APA
Bai, G., Chai, Z., Ling, C., Wang, S., Lu, J., Zhang, N., Shi, T., Yu, Z., Zhu, M., Zhang, Y., Song, X., Yang, C., Cheng, Y., & Zhao, L. (2026). Beyond Efficiency: A Systematic Survey of Resource-Efficient Large Language Models. ACM Computing Surveys, 58(16), 1-45. https://doi.org/10.1145/3845797
Vancouver
Bai G, Chai Z, Ling C, Wang S, Lu J, Zhang N, et al. Beyond Efficiency: A Systematic Survey of Resource-Efficient Large Language Models. ACM Computing Surveys. 2026;58(16):1-45. doi:10.1145/3845797
BibTeX
@article{Bai2026,
author = {Bai, Guangji and Chai, Zheng and Ling, Chen and Wang, Shiyu and Lu, Jiaying and Zhang, Nan and Shi, Tingwei and Yu, Ziyang and Zhu, Mengdan and Zhang, Yifei and Song, Xinyuan and Yang, Carl and Cheng, Yue and Zhao, Liang},
title = {Beyond Efficiency: A Systematic Survey of Resource-Efficient Large Language Models},
journal = {ACM Computing Surveys},
year = {2026},
volume = {58},
number = {16},
pages = {1--45},
doi = {10.1145/3845797}
}
EUVIMED