A General-Purpose Deep Reinforcement Learning Approach for Dynamic Inventory Control

25 Pages Posted: 4 Apr 2024

See all articles by Magnus Josef Maichle

Magnus Josef Maichle

University of Würzburg - Business Administration & Economics

Nikolai Stein

University of Würzburg - Business Administration & Economics

Richard Pibernik

University of Würzburg - Business Administration & Economics

Carlo D'Eramo

University of Würzburg - Institute of Computer Science

Date Written: March 12, 2024

Abstract

Solving real-world inventory problems poses many challenges, including the estimation of uncertain parameters (e.g. demand), dealing with their dynamic nature that often results in prohibitive computational complexity, and handling objective functions that are mathematically complex and not well-behaved. Deep Reinforcement Learning (DRL)-based approaches carry the promise of addressing the aforementioned challenges and problems—they have been applied in other domains with similar challenges and were recently also applied to selected inventory management problems.
This paper presents a novel DRL-based approach to dynamic inventory control that can effectively
leverage contextual information (features) and is versatile in the sense that it can be successfully applied to various different types of (dynamic) inventory control problems. The versatility of our approach stems from its ability to handle complex (non-continuous) loss functions and to account for partial observability of the state space—an important property of many dynamic inventory control problems that has so far not received adequate attention. Based on a large set of numerical studies for three distinct problems (Newsvendor, Lost Sales, and Multi-Period Fixed-Cost problem), we can show that our approach is not only versatile but also leads to superior performance compared to state-of-the-art benchmarks.

Keywords: Dynamic inventory control, prescriptive analytics, machine learning, reinforcement learning

JEL Classification: M11

Suggested Citation

Maichle, Magnus Josef and Stein, Nikolai and Pibernik, Richard and D'Eramo, Carlo, A General-Purpose Deep Reinforcement Learning Approach for Dynamic Inventory Control (March 12, 2024). Available at SSRN: https://ssrn.com/abstract=4754937 or http://dx.doi.org/10.2139/ssrn.4754937

Magnus Josef Maichle (Contact Author)

University of Würzburg - Business Administration & Economics ( email )

Sanderring 2
Wuerzburg, D-97070
Germany

Nikolai Stein

University of Würzburg - Business Administration & Economics ( email )

Sanderring 2
Wuerzburg, D-97070
Germany

Richard Pibernik

University of Würzburg - Business Administration & Economics ( email )

Sanderring 2
Wuerzburg, D-97070
Germany

Carlo D'Eramo

University of Würzburg - Institute of Computer Science ( email )

Sanderring 2
Würzburg
Germany

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
117
Abstract Views
302
Rank
453,113
PlumX Metrics