Statistical Analysis of Results from Laboratory Studies in Experimental Economics: A Critique of Current Practice

37 Pages Posted: 28 Nov 2012

See all articles by Donald P. Green

Donald P. Green

Columbia University

Andrej Tusicisny

Columbia University - Department of Political Science

Date Written: November 27, 2012

Abstract

Drawing on examples of recently published and widely-cited studies in experimental economics, we show that behavioral games are frequently analyzed in a manner that is prone to biased causal inference. First, deficiencies in design and implementation jeopardize the crucial assumption that treatments are statistically independent of potential outcomes. Researchers frequently do not randomly assign treatments or do not focus on randomly assigned factors when interpreting results. Second, many analyses of second mover behaviors in two-stage games, such as the ultimatum game and the trust game, are susceptible to bias. Third, uncontrolled stimuli, such as face-to-face interaction among subjects or the presentation of subjects’ photos, may also cause bias. Fourth, we discuss the limits of causal inference in repeated games, such as the public goods game. We recommend adjusting laboratory procedures and estimation methods in order to lessen reliance on substantive assumptions not grounded in experimental design.

Keywords: Experimental Economics, Laboratory Experiments, Causal Inference, Average Treatment Effect

JEL Classification: C13, C18, C51, C91

Suggested Citation

Green, Donald P. and Tusicisny, Andrej, Statistical Analysis of Results from Laboratory Studies in Experimental Economics: A Critique of Current Practice (November 27, 2012). Available at SSRN: https://ssrn.com/abstract=2181654 or http://dx.doi.org/10.2139/ssrn.2181654

Donald P. Green

Columbia University ( email )

7th Floor, International Affairs Bldg.
420 W. 118th Street
New York, NY 10027
United States

Andrej Tusicisny (Contact Author)

Columbia University - Department of Political Science ( email )

7th Floor, International Affairs Bldg.
420 W. 118th Street
New York, NY 10027
United States

HOME PAGE: http://www.tusicisny.com

Here is the Coronavirus
related research on SSRN

Paper statistics

Downloads
188
Abstract Views
958
rank
175,478
PlumX Metrics