EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Network Edge Inference for Large Language Models: Principles, Techniques, and Opportunities

Zhixiong Chen, Bingjie Zhu, Jiangzhou Wang, Hyundong Shin, Arumugam Nallanathan, Dusit (Tao) Niyato

ACM Computing Surveys · 30.09.2026 · 58 (12) · 1-35

DOI: 10.1145/3809166 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 19.05.2026. Verfasst von Zhixiong Chen und 5 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 211 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large language models (LLMs) have advanced rapidly, emerging as versatile tools across fields thanks to their exceptional language understanding, generation, and reasoning capabilities. However, performing LLM inference at the network edge remains challenging due to their large memory and compute demands. This survey outlines the challenges specific to LLM edge inference and provides a comprehensive overview of recent progress, covering system architectures, model optimization and deployment, and resource management and scheduling. By synthesizing state-of-the-art techniques and mapping future directions, this survey aims to unlock the potential of LLMs in resource-constrained edge environments.

Zitieren

APA

Chen, Z., Zhu, B., Wang, J., Shin, H., Nallanathan, A., & Niyato, D. T. (2026). Network Edge Inference for Large Language Models: Principles, Techniques, and Opportunities. ACM Computing Surveys, 58(12), 1-35. https://doi.org/10.1145/3809166

Vancouver

Chen Z, Zhu B, Wang J, Shin H, Nallanathan A, Niyato DT. Network Edge Inference for Large Language Models: Principles, Techniques, and Opportunities. ACM Computing Surveys. 2026;58(12):1-35. doi:10.1145/3809166

BibTeX
@article{Chen2026,
  author = {Chen, Zhixiong and Zhu, Bingjie and Wang, Jiangzhou and Shin, Hyundong and Nallanathan, Arumugam and Niyato, Dusit (Tao)},
  title = {Network Edge Inference for Large Language Models: Principles, Techniques, and Opportunities},
  journal = {ACM Computing Surveys},
  year = {2026},
  volume = {58},
  number = {12},
  pages = {1--35},
  doi = {10.1145/3809166}
}
Kostenlos starten →