A Robust Approach for Hotspots Prevention and Resolution in Cloud Services

29 Pages Posted: 7 Dec 2022

See all articles by Jiaxi Wu

Jiaxi Wu

Huawei Cloud Computing Technologies Co Ltd

Wenquan Yang

Huawei Cloud Computing Technologies Co Ltd

Xinming Han

Peking University

Yunzhe Qiu

Peking University - Department of Information Management

Andrei Gudkov

Independent

Date Written: November 30, 2022

Abstract

Cloud providers offer virtual machines (VM) located in physical machines (PM) using the “pay-as-you-go” model to satisfy emerging demand for online computational services. If the instantaneous utilized capacity requested by VMs exceeds a certain threshold of the total capacity a PM can offer, a hotspot happens and may cause unacceptable VM performance degradation. Hotspots can be resolved by relocating some VMs to other PMs using live migration. However, the problem of selecting which VM(s) to release is challenging because the utilized capacity demanded by VMs changes continuously over time. In this work, we propose a Predicted Mixed Integer Linear Programming (MILP) Robust Solver (PMRS), which predicts the utilized capacity range of each VM and applies the Γ-robustness theory to ensure that PM is hotspot-safe with desired probability. The latter allows us to formulate the hotspot resolution as a Γ-robust knapsack problem (Γ-RKP) that can be solved by a novel MILP model. Extensive experiments based on real-trace data and large-scale synthetic data demonstrate the effectiveness of the PMRS. More encouragingly, the application of the PMRS in the real-production environment benefits Huawei Cloud by resolving all existing and 94%+ potential future hotspots with minimal migration overhead.

Keywords: Cloud service, hotspot prevention, Γ-robustness, knapsack problem, data-driven optimization

JEL Classification: C61, C63

Suggested Citation

Wu, Jiaxi and Yang, Wenquan and Han, Xinming and Qiu, Yunzhe and Gudkov, Andrei, A Robust Approach for Hotspots Prevention and Resolution in Cloud Services (November 30, 2022). Available at SSRN: https://ssrn.com/abstract=4289162 or http://dx.doi.org/10.2139/ssrn.4289162

Jiaxi Wu

Huawei Cloud Computing Technologies Co Ltd

Wenquan Yang

Huawei Cloud Computing Technologies Co Ltd

Xinming Han

Peking University

Yunzhe Qiu (Contact Author)

Peking University - Department of Information Management ( email )

Beijing, 100087
China

Andrei Gudkov

Independent

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
55
Abstract Views
307
Rank
710,747
PlumX Metrics