Decision Theoretic Approaches to Experiment Design and External Validity

49 Pages Posted: 27 Apr 2016 Last revised: 19 May 2018

See all articles by Abhijit V. Banerjee

Abhijit V. Banerjee

Massachusetts Institute of Technology (MIT) - Department of Economics

Sylvain Chassang

Princeton University William S. Dietrich II Economic Theory Center

Erik Snowberg

California Institute of Technology - Division of the Humanities and Social Sciences; National Bureau of Economic Research (NBER)

Multiple version iconThere are 2 versions of this paper

Date Written: April 25, 2016

Abstract

A modern, decision-theoretic framework can help clarify important practical questions of experimental design. Building on our recent work, this chapter begins by summarizing our framework for understanding the goals of experimenters, and applying this to re-randomization.

We then use this framework to shed light on questions related to experimental registries, preanalysis plans, and most importantly, external validity. Our framework implies that even when large samples can be collected, external decision-making remains inherently subjective. We embrace this conclusion, and argue that in order to improve external validity, experimental research needs to create a space for structured speculation.

Suggested Citation

Banerjee, Abhijit V. and Chassang, Sylvain and Snowberg, Erik, Decision Theoretic Approaches to Experiment Design and External Validity (April 25, 2016). Princeton University William S. Dietrich II Economic Theory Center Research Paper No. 080_2016, Available at SSRN: https://ssrn.com/abstract=2770140 or http://dx.doi.org/10.2139/ssrn.2770140

Abhijit V. Banerjee

Massachusetts Institute of Technology (MIT) - Department of Economics ( email )

50 Memorial Drive
Room E52-252D
Cambridge, MA 02142
United States
617-253-8855 (Phone)
617-253-6915 (Fax)

Sylvain Chassang (Contact Author)

Princeton University William S. Dietrich II Economic Theory Center ( email )

Princeton, NJ 08544-1021
United States

Erik Snowberg

California Institute of Technology - Division of the Humanities and Social Sciences ( email )

1200 East California Blvd.
Pasadena, CA 91125
United States

National Bureau of Economic Research (NBER)

1050 Massachusetts Avenue
Cambridge, MA 02138
United States

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
174
Abstract Views
774
Rank
152,110
PlumX Metrics