The Benefits of Delay to Online Decision-Making

Abstract

Real-time decisions are usually irrevocable in many contexts of online decision-making. One common practice is delaying real-time decisions so that the decision-maker can gather more information to make better decisions (for example, in online retailing, there is typically a time delay between when an online order is received and when it gets picked and assembled for shipping). However, decisions cannot be delayed forever. In this paper, we study this fundamental trade-off and aim to theoretically characterize the benefits of delaying real-time decisions. We provide such a theoretical foundation for a broad family of online decision- making problems by proving that the gap between the proposed online algorithm with delay and the offline optimal hindsight policy decays exponentially fast in the length of delay. We also conduct extensive numerical experiments on the benefits of delay, using both synthetic and real data that is publicly available. Both our theoretical and empirical results suggest that a little delay is all we need.

Keywords: online decision-making, resource allocation, delay, batching, multisecretary problem, order fulfillment, multi-item order