default author photo

Zhongguo Li

Southeast University, Nanjing

SCHOLARLY PAPERS

1

DOWNLOADS

29

TOTAL CITATIONS

0

Scholarly Papers (1)

Actions:
Email selected abstracts
1.

Load Balancing for Large Language Model Inference Serving: A Control and Learning Oriented Survey

Number of pages: 43 Posted: 18 Jun 2026
Hanbo Ma, Zhongguo Li, Junan Wang, Chunyi Cao, Donglin Li, Jun Yang and Zhengtao Ding
The University of Manchester - Department of Electrical and Electronic Engineering, Southeast University, Nanjing, The University of Manchester - Department of Electrical and Electronic Engineering, The University of Manchester - Department of Electrical and Electronic Engineering, The University of Manchester - Department of Electrical and Electronic Engineering, Loughborough University and The University of Manchester - Department of Electrical and Electronic Engineering
Downloads 29

Abstract:

Loading...

Large language models, Neural Network Inference, Load Balancing, Intelligent Scheduling, resource allocation, KV Cache