Conducting Interactive Experiments Online

32 Pages Posted: 13 Dec 2016 Last revised: 30 Jan 2017

See all articles by Antonio Arechar

Antonio Arechar

Massachusetts Institute of Technology (MIT)

Simon Gaechter

University of Nottingham; IZA Institute of Labor Economics; CESifo (Center for Economic Studies and Ifo Institute)

Lucas Molleman

Max Planck Institute for Human Development Berlin

Multiple version iconThere are 2 versions of this paper

Date Written: January 29, 2017

Abstract

Online labor markets provide new opportunities for behavioral research, but conducting economic experiments online raises important methodological challenges. This particularly holds for interactive designs. In this paper, we provide a methodological discussion of the similarities and differences between interactive experiments conducted in the laboratory and online. To this end, we conduct a repeated public goods experiment with and without punishment using samples from the laboratory and the online platform Amazon Mechanical Turk. We chose to replicate this experiment because it is long and logistically complex, providing a good case study for discussing the methodological and practical challenges of online interactive experimentation. We find that basic behavioral patterns of cooperation and punishment in the laboratory are replicable online. The most important challenge of online interactive experiments is subject dropout. We discuss measures for reducing dropout and show that, for our case study, dropouts are exogenous to the experiment. We conclude that data quality for interactive experiments via the Internet is adequate and reliable, making online interactive experimentation a valuable complement to laboratory studies.

Suggested Citation

Arechar, Antonio and Gachter, Simon and Molleman, Lucas, Conducting Interactive Experiments Online (January 29, 2017). Available at SSRN: https://ssrn.com/abstract=2884409 or http://dx.doi.org/10.2139/ssrn.2884409

Antonio Arechar (Contact Author)

Massachusetts Institute of Technology (MIT) ( email )

77 Massachusetts Avenue
50 Memorial Drive
Cambridge, MA 02139-4307
United States

Simon Gachter

University of Nottingham ( email )

University Park
Nottingham, NG8 1BB
United Kingdom

IZA Institute of Labor Economics

P.O. Box 7240
Bonn, D-53072
Germany

CESifo (Center for Economic Studies and Ifo Institute)

Poschinger Str. 5
Munich, DE-81679
Germany

Lucas Molleman

Max Planck Institute for Human Development Berlin ( email )

Lentzeallee 94
Berlin, D-14195
Germany

Register to save articles to
your library

Register

Paper statistics

Downloads
130
rank
192,038
Abstract Views
799
PlumX Metrics
!

Under construction: SSRN citations while be offline until July when we will launch a brand new and improved citations service, check here for more details.

For more information