Designing and Analyzing Randomized Experiments: Application to a Japanese Election Survey Experiment

American Journal of Political Science, Vol. 51, No. 3, pp. 669–687, July 2007

Posted: 28 Sep 2011

See all articles by Yusaku Horiuchi

Yusaku Horiuchi

Dartmouth College - Department of Government

Kosuke Imai

Princeton University - Department of Political Science

Naoko Taniguchi

affiliation not provided to SSRN

Date Written: July 1, 2007

Abstract

Randomized experiments are becoming increasingly common in political science. Despite their well-known advantages over observational studies, randomized experiments are not free from complications. In particular, researchers often cannot force subjects to comply with treatment assignment and to provide the requested information. Furthermore, simple randomization of treatments remains the most commonly used method in the discipline even though more efficient procedures are available. Building on the recent statistical literature, we address these methodological issues by offering general recommendations for designing and analyzing randomized experiments to improve the validity and efficiency of causal inference. We also develop a new statistical methodology to explore causal heterogeneity. The proposed methods are applied to a survey experiment conducted during Japan's 2004 Upper House election, where randomly selected voters were encouraged to obtain policy information from political parties' websites. An R package is publicly available for implementing various methods useful for designing and analyzing randomized experiments.

Keywords: randomized experiment, non-compliance, non-response, causal heterogeneity, Japan

JEL Classification: C90, C91, C11

Suggested Citation

Horiuchi, Yusaku and Imai, Kosuke and Taniguchi, Naoko, Designing and Analyzing Randomized Experiments: Application to a Japanese Election Survey Experiment (July 1, 2007). American Journal of Political Science, Vol. 51, No. 3, pp. 669–687, July 2007. Available at SSRN: https://ssrn.com/abstract=1934602

Yusaku Horiuchi (Contact Author)

Dartmouth College - Department of Government ( email )

204 Silsby Hall
HB 6108
Hanover, NH 03755
United States

HOME PAGE: http://sites.dartmouth.edu/horiuchi/

Kosuke Imai

Princeton University - Department of Political Science ( email )

Corwin Hall
Princeton, NJ 08544-1012
United States

Naoko Taniguchi

affiliation not provided to SSRN ( email )

No Address Available

Register to save articles to
your library

Register

Paper statistics

Abstract Views
417
PlumX Metrics