A Replication Study of Operations Management Experiments in Management Science

Management Science 69(9):4977-4991.

51 Pages Posted: 17 Jun 2022 Last revised: 9 Nov 2023

See all articles by Andrew M. Davis

Andrew M. Davis

Samuel Curtis Johnson Graduate School of Management, Cornell University

Blair Flicker

Darla Moore School of Business, University of South Carolina

Kyle B. Hyndman

University of Texas at Dallas

Elena Katok

University of Texas at Dallas

Samantha Keppler

University of Michigan Stephen M. Ross School of Business

Stephen Leider

University of Michigan, Stephen M. Ross School of Business

Xiaoyang Long

University of Wisconsin - Madison - School of Business

Jordan Tong

Wisconsin School of Business

Date Written: May 22, 2023

Abstract

Over the past two decades, researchers in operations management have increasingly leveraged laboratory experiments to identify key behavioral insights. These experiments inform behavioral theories of operations management, impacting domains including inventory, supply chain management, queuing, forecasting, and sourcing. Yet, until now, the replicability of most behavioral insights from these laboratory experiments has been untested. We remedy this with the first large-scale replication study in operations management. With the input of the wider operations management community, we identify ten prominent experimental operations management papers published in Management Science, which span a variety of domains, to be the focus of our replication effort. For each paper, we conduct a high-powered replication study of the main results across multiple locations using original materials (when available and suitable). In addition, our study tests replicability in multiple modalities (in-person and online) due to laboratory closures during the COVID-19 pandemic. Our replication study contributes new knowledge about the robustness of several key behavioral theories in operations management, and contributes more broadly to efforts in the operations management field to improve research transparency and reliability.

Keywords: Replication, Operations Management, Experiments, Management Science Replication Project

Suggested Citation

Davis, Andrew M. and Flicker, Blair and Hyndman, Kyle B. and Katok, Elena and Keppler, Samantha and Leider, Stephen and Long, Xiaoyang and Tong, Jordan, A Replication Study of Operations Management Experiments in Management Science (May 22, 2023). Management Science 69(9):4977-4991., Available at SSRN: https://ssrn.com/abstract=4135500 or http://dx.doi.org/10.2139/ssrn.4135500

Andrew M. Davis (Contact Author)

Samuel Curtis Johnson Graduate School of Management, Cornell University ( email )

Ithaca, NY 14853
United States

Blair Flicker

Darla Moore School of Business, University of South Carolina ( email )

United States

Kyle B. Hyndman

University of Texas at Dallas ( email )

2601 North Floyd Road
P.O. Box 830688
Richardson, TX 75083
United States

Elena Katok

University of Texas at Dallas ( email )

Jindal School of Management
800 W. Campbell Dr.
Richardson, TX 75080
United States

HOME PAGE: http://www.utdallas.edu/~ekatok/

Samantha Keppler

University of Michigan Stephen M. Ross School of Business ( email )

701 Tappan St
Ann Arbor, MI 48109-1234
United States

Stephen Leider

University of Michigan, Stephen M. Ross School of Business ( email )

701 Tappan Street
Ann Arbor, MI MI 48109
United States

HOME PAGE: http://www-personal.umich.edu/~leider/

Xiaoyang Long

University of Wisconsin - Madison - School of Business ( email )

Madison, WI
United States

Jordan Tong

Wisconsin School of Business ( email )

975 University Avenue
Madison, WI 53706
United States

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
443
Abstract Views
1,275
Rank
122,849
PlumX Metrics