DMS, Kafka, CDMS, Genetic Algorithm, Particle Swarm Optimization
Large language models, Neural Network Inference, Load Balancing, Intelligent Scheduling, resource allocation, KV Cache
Large Language Models, LLM Serving, Load Balancing, Inference Systems, Intelligent Scheduling